00000001:02000400:0.0F:1788832907.918648:0:2952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788832916.394912:0:3154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788832917.320374:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1331 MB/s 00000001:01000000:0.0:1788832917.570539:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1639 MB/s 00000001:01000000:0.0:1788832917.820084:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10331 MB/s 00000020:02000000:3.0:1788832918.127179:0:3245:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_106_g45f4cc0 00000400:02000000:3.0:1788832918.513490:0:3260:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.155@tcp [8/256/0/180] 00008000:02000000:0.0:1788832920.952567:0:3409:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788832968.996927:0:5210:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788832977.846191:0:5793:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788832977.846197:0:5793:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788832977.846332:0:5793:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001563091c 00000080:02000400:3.0:1788832977.846343:0:5793:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788832977.852454:0:5793:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788832977.852549:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0F:1788832977.852652:0:5793:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a5979a2c) 00000020:00000080:2.0:1788832977.852678:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788832977.865317:0:5793:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788832977.865783:0:5793:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788832977.886609:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788832977.886651:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788832977.886672:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788832977.886723:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788832977.886749:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788832977.887349:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788832977.887432:0:5793:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788832977.887445:0:5793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3fe683 00000020:01000004:3.0:1788832977.887454:0:5793:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788832977.887458:0:5793:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788832977.887462:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001563091c from MGS 00000020:01000004:3.0:1788832977.887466:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788832977.887489:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ff2172ec) 00000020:00000080:3.0:1788832977.887500:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788832977.887611:0:5793:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001563091c from MGS, refs=2 00080000:01000000:3.0:1788832977.887617:0:5793:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788832977.887622:0:5793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3fe691 00000100:00100000:3.0:1788832977.887718:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788832977.887868:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788832977.887875:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788832977.888626:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788832977.888634:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788832977.889564:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832977.889742:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788832977.889752:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788832977.890601:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788832977.890608:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788832977.891023:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788832977.891234:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788832977.891785:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832977.891789:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832977.891790:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832977.892268:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832977.892271:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832977.892272:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832977.892813:0:5793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788832977.900498:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788832978.142192:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3195 MB/s 00000001:01000000:3.0:1788832978.395722:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3359 MB/s 00000001:01000000:3.0:1788832978.645323:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 471 MB/s 00000001:01000000:3.0:1788832978.896306:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1179 MB/s 00080000:10000000:0.0:1788832978.922571:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788832978.930808:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788832978.963114:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788832978.965310:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788832978.965317:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788832978.967790:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788832978.968104:0:5793:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788832978.968175:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788832978.968395:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788832978.968421:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788832978.968760:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832978.968930:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788832978.968935:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788832978.981980:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788832978.982390:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788832978.982756:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788832978.982763:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788832978.984143:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788832978.984166:0:5793:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.155@tcp' 00000020:01000004:2.0:1788832978.984168:0:5793:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788832978.984222:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.155@tcp (typ=mgc) 00000020:00000080:2.0:1788832978.984234:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.155@tcp (000000005e78dcbd) 00000020:00000080:2.0:1788832978.984249:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788832978.984337:0:5793:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004ca4684d@MGC192.168.206.155@tcp: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1788832978.984526:0:5793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.155@tcp-0 is initialized 00000040:01000000:2.0:1788832978.984533:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788832978.986437:0:5808:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788832978.988850:0:5809:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788832978.988942:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.155@tcp (uuid 50e9edd7-a155-4c7b-bcad-c363b29ac1f4) 00000020:00000080:2.0:1788832978.988963:0:5793:0:(genops.c:1385:class_connect()) connect: client 50e9edd7-a155-4c7b-bcad-c363b29ac1f4, cookie 0x8c08e876ed3fe69f 00000100:00080000:2.0:1788832978.988975:0:5793:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832978.988979:0:5793:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import 000000004ca4684d using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788832978.989019:0:5793:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dc8a2f48 x1875727265824896/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832978.989236:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc8a2f48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3275:1875727265824896:0@lo:250: 00000100:00100000:2.0:1788832978.989314:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788832978.996206:0:5793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS 00000020:01000004:2.0:1788832978.996231:0:5793:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788832978.996289:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788832978.996302:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c3624004) 00000020:00000080:2.0:1788832978.996332:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0F:1788832978.999460:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265824896 00000100:00100000:1.0:1788832978.999477:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265824896 00000100:00100000:1.0:1788832978.999540:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832978.999547:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cde4863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3275:x1875727265824896:12345-0@lo:250: 00010000:00080000:1.0:1788832978.999572:0:5806:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 50e9edd7-a155-4c7b-bcad-c363b29ac1f4@0@lo t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:1.0:1788832978.999598:0:5806:0:(genops.c:1385:class_connect()) connect: client 50e9edd7-a155-4c7b-bcad-c363b29ac1f4, cookie 0x8c08e876ed3fe6ad 00000100:00080000:1.0:1788832978.999737:0:5806:0:(import.c:65:import_set_state_nolock()) 00000000d4b767a0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832978.999848:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cde4863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:3275:x1875727265824896:12345-0@lo:250: Request processed in 300us (10535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832978.999855:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832978.999924:0:3275:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788832978.999933:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.155@tcp: connect to target with instance 0 00000100:00080000:1.0:1788832978.999940:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788832978.999944:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788832978.999947:0:3275:0:(import.c:65:import_set_state_nolock()) 000000004ca4684d MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788832978.999950:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788832978.999959:0:3275:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788832978.999964:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc8a2f48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3275:1875727265824896:0@lo:250: 00000100:00100000:1.0:1788832979.016551:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832979.016731:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832979.016736:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788832979.018027:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788832979.018434:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788832979.018883:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788832979.018890:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788832979.019819:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832979.020241:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788832979.020247:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788832979.020736:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788832979.020743:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788832979.054945:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832979.055573:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788832979.055581:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788832979.056692:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788832979.056701:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788832979.059519:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832979.059724:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788832979.059730:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788832979.060661:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788832979.060670:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788832979.061593:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832979.061789:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788832979.061795:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788832979.062607:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832979.062615:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788832979.063548:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832979.063730:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788832979.063736:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788832979.064309:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832979.064316:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788832979.109643:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832979.109919:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788832979.109925:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788832979.112139:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788832979.112153:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788832979.113323:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788832979.113334:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788832979.115225:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788832979.115253:0:5793:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788832979.115259:0:5793:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788832979.115415:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788832979.115445:0:5793:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.155@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788832979.115450:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788832979.115452:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832979.115453:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832979.115454:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832979.115455:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832979.115457:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832979.115458:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832979.115459:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832979.115461:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832979.115462:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832979.115463:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832979.115464:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788832979.115466:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788832979.115469:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832979.115470:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832979.115471:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832979.115472:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832979.115473:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832979.115474:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832979.115475:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832979.115476:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832979.115477:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832979.115478:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832979.115479:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832979.115480:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788832979.115526:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788832979.115545:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0058c30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825024:0@lo:253: 00000100:00100000:1.0:1788832979.115628:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.115840:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825024 00000100:00100000:0.0:1788832979.115859:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825024 00000100:00100000:0.0:1788832979.115921:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832979.115929:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ca7f702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:5793:x1875727265825024:12345-0@lo:253: 20000000:01000000:0.0:1788832979.115969:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788832979.115972:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788832979.116247:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1788832979.116306:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d46e02e going to sleep for 11 seconds 20000000:01000000:0.0:1788832979.116384:0:5807:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788832979.116661:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832979.118011:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788832979.118478:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788832979.118483:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788832979.118489:0:5807:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788832979.118492:0:5807:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788832979.118506:0:5807:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788832979.118814:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832979.119536:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788832979.119555:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788832979.119623:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788832979.119763:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788832979.119809:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788832979.119921:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788832979.119931:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788832979.119982:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788832979.119990:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788832979.120129:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788832979.120138:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788832979.120172:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788832979.120223:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788832979.120258:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788832979.120263:0:5807:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788832979.120277:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832979.120574:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788832979.120584:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788832979.120624:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788832979.120663:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788832979.120809:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788832979.120823:0:5807:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788832979.120900:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788832979.120909:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788832979.120953:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788832979.120992:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788832979.121025:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788832979.121171:0:5807:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788832979.121276:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788832979.121286:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788832979.121321:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788832979.121438:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788832979.121625:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788832979.121670:0:5807:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788832979.121755:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788832979.122458:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788832979.122850:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788832979.122874:0:5807:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.155@tcp for mdt 20000000:01000000:0.0:1788832979.122876:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.155@tcp (null) (null) (null) 00000040:00080000:0.0:1788832979.122925:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788832979.122934:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788832979.122963:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788832979.122971:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.155@tcp (null) (null) 00000040:00080000:0.0:1788832979.123014:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788832979.123025:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788832979.123253:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788832979.123290:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788832979.123424:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788832979.123427:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788832979.123432:0:5807:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788832979.123438:0:5807:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788832979.123987:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788832979.124192:0:5807:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788832979.141802:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788832979.141853:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788832979.141946:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788832979.141964:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788832979.141966:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788832979.141969:0:5807:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788832979.141980:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788832979.141982:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788832979.142008:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788832979.142010:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788832979.142935:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788832979.143262:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788832979.143305:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788832979.143341:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788832979.143430:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788832979.143433:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788832979.143914:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788832979.144235:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788832979.144274:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788832979.144332:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1788832979.144345:0:5807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832979.144347:0:5807:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788832979.144424:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788832979.144443:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144459:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144468:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144474:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144488:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144494:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144500:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000ce46317 already unused, calling callback (000000008264ce99) 00010000:00010000:1.0:1788832979.144503:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144522:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144535:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144542:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.144547:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ce46317/0x8c08e876ed3fe6b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832979.144565:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788832979.323552:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ca7f702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:5793:x1875727265825024:12345-0@lo:253: Request processed in 207617us (207917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832979.323571:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832979.323669:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0058c30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825024:0@lo:253: 10000000:01000000:1.0:1788832979.323684:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788832979.323687:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832979.323688:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832979.323690:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832979.323691:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788832979.323692:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832979.323705:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832979.323706:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832979.323708:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832979.323709:0:5793:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788832979.323710:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832979.323712:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788832979.323728:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001563091c from lustre-MDT0000 10000000:01000000:1.0:1788832979.323750:0:5793:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788832979.323753:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788832979.323757:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cea10ad4d28 10000000:01000000:1.0:1788832979.323761:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788832979.323767:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cea10ad4d28 from 1 10000000:01000000:1.0:1788832979.323770:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788832979.323804:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 000000000ce46317/0x8c08e876ed3fe6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.323813:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 000000000ce46317/0x8c08e876ed3fe6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.323822:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 000000000ce46317/0x8c08e876ed3fe6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832979.323839:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0058c30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825152:0@lo:101: 00000100:00100000:1.0:1788832979.323872:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832979.323926:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c841cf06 going to sleep for 11 seconds 00000100:00100000:3.0:1788832979.323987:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825152 00000100:00100000:3.0:1788832979.323993:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825152 00000100:00100000:3.0:1788832979.324069:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832979.324077:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028a7bbf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:5793:x1875727265825152:12345-0@lo:101: 00010000:00010000:3.0:1788832979.324089:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832979.324107:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003dbb9118/0x8c08e876ed3fe6c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe6bb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.324130:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003dbb9118/0x8c08e876ed3fe6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.324140:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003dbb9118/0x8c08e876ed3fe6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.324148:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003dbb9118, rc 0) 00000100:00100000:3.0:1788832979.324178:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028a7bbf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+6:5793:x1875727265825152:12345-0@lo:101: Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832979.324184:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832979.324303:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0058c30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825152:0@lo:101: 00010000:00010000:2.0:1788832979.324315:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 000000000ce46317/0x8c08e876ed3fe6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.324323:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 000000000ce46317/0x8c08e876ed3fe6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832979.324435:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825280:0@lo:501: 00000100:00100000:2.0:1788832979.324464:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832979.324491:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000008df9af9e going to sleep for 11 seconds 00000100:00100000:3.0:1788832979.324552:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825280 00000100:00100000:3.0:1788832979.324557:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825280 00000100:00100000:3.0:1788832979.324624:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832979.324631:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025cc5fbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+6:5793:x1875727265825280:12345-0@lo:501: 00000100:00100000:3.0:1788832979.324833:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025cc5fbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+6:5793:x1875727265825280:12345-0@lo:501: Request processed in 202us (368us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832979.324840:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832979.324902:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825280:0@lo:501: 10000000:01000000:2.0:1788832979.324924:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788832979.324942:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 000000000ce46317/0x8c08e876ed3fe6bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.324949:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 000000000ce46317/0x8c08e876ed3fe6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832979.324957:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cea100dd800 10000000:01000000:2.0:1788832979.324960:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788832979.324964:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cea100dd800 10000000:01000000:2.0:1788832979.324966:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788832979.324968:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cea100dd800 from 1 10000000:01000000:2.0:1788832979.324970:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788832979.324989:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 0000000094527788/0x8c08e876ed3fe6c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.324995:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 0000000094527788/0x8c08e876ed3fe6c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.325002:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 0000000094527788/0x8c08e876ed3fe6c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832979.325012:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825408:0@lo:101: 00000100:00100000:2.0:1788832979.325059:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832979.325225:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000008df9af9e going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.325327:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825408 00000100:00100000:1.0:1788832979.325332:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825408 00000100:00100000:1.0:1788832979.325368:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832979.325375:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2362d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+6:5793:x1875727265825408:12345-0@lo:101: 00010000:00010000:1.0:1788832979.325382:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832979.325392:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4a25aa2/0x8c08e876ed3fe6d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe6c9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.325420:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4a25aa2/0x8c08e876ed3fe6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6c9 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.325438:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4a25aa2/0x8c08e876ed3fe6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6c9 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.325444:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4a25aa2, rc 0) 00000100:00100000:1.0:1788832979.325483:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2362d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+7:5793:x1875727265825408:12345-0@lo:101: Request processed in 109us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.325489:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788832979.325571:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825408:0@lo:101: 00010000:00010000:2.0:1788832979.325581:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 0000000094527788/0x8c08e876ed3fe6c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.325588:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 0000000094527788/0x8c08e876ed3fe6c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832979.325613:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788832979.325627:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 0000000094527788/0x8c08e876ed3fe6c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.325634:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 0000000094527788/0x8c08e876ed3fe6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832979.325640:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788832979.325644:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788832979.325648:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cea100dd800 10000000:01000000:2.0:1788832979.325650:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788832979.325653:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788832979.325655:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788832979.325668:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 00000000362352f4/0x8c08e876ed3fe6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.325673:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 00000000362352f4/0x8c08e876ed3fe6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.325679:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 00000000362352f4/0x8c08e876ed3fe6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832979.325690:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825536:0@lo:101: 00000100:00100000:2.0:1788832979.325715:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832979.325726:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000008df9af9e going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.325785:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825536 00000100:00100000:1.0:1788832979.325789:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825536 00000100:00100000:1.0:1788832979.325806:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832979.325811:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3884595 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+7:5793:x1875727265825536:12345-0@lo:101: 00010000:00010000:1.0:1788832979.325818:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832979.325825:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a272b0ef/0x8c08e876ed3fe6de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe6d7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.325842:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a272b0ef/0x8c08e876ed3fe6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.325849:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a272b0ef/0x8c08e876ed3fe6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.325855:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a272b0ef, rc 0) 00000100:00100000:1.0:1788832979.325889:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3884595 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+8:5793:x1875727265825536:12345-0@lo:101: Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.325895:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832979.326837:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825536:0@lo:101: 00010000:00010000:2.0:1788832979.326853:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 00000000362352f4/0x8c08e876ed3fe6d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.326878:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 00000000362352f4/0x8c08e876ed3fe6d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832979.326929:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825664:0@lo:501: 00000100:00100000:2.0:1788832979.326977:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832979.327012:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000008df9af9e going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.327121:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825664 00000100:00100000:1.0:1788832979.327127:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825664 00000100:00100000:1.0:1788832979.327154:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832979.327160:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a493069d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+8:5793:x1875727265825664:12345-0@lo:501: 00000100:00100000:1.0:1788832979.327403:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a493069d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5793:x1875727265825664:12345-0@lo:501: Request processed in 243us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.327411:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788832979.327582:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825664:0@lo:501: 00000100:00100000:2.0:1788832979.327613:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825792:0@lo:503: 00000100:00100000:2.0:1788832979.327651:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832979.327677:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000008df9af9e going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.327733:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825792 00000100:00100000:1.0:1788832979.327738:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825792 00000100:00100000:1.0:1788832979.327755:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788832979.327760:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1edcb6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5793:x1875727265825792:12345-0@lo:503: 00000100:00100000:1.0:1788832979.327898:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1edcb6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5793:x1875727265825792:12345-0@lo:503: Request processed in 138us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.327904:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832979.327988:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265825792:0@lo:503: 00000100:00100000:2.0:1788832979.328469:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5836:1875727265825920:0@lo:502: 00000100:00100000:2.0:1788832979.328505:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832979.328542:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000008df9af9e going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.328593:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265825920 00000100:00100000:1.0:1788832979.328597:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265825920 00000100:00100000:1.0:1788832979.328616:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832979.328620:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001997b415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5836:x1875727265825920:12345-0@lo:502: 00000100:00100000:1.0:1788832979.328762:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001997b415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5836:x1875727265825920:12345-0@lo:502: Request processed in 141us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.328769:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832979.328844:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5836:1875727265825920:0@lo:502: 00000020:01000000:2.0:1788832979.328866:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832979.328876:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.328878:0:5836:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788832979.328883:0:5836:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788832979.328886:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832979.328899:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f6549f95) 00000020:00000080:2.0:1788832979.328916:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788832979.328921:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788832979.329013:0:5836:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788832979.329019:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3fe6ec 00000020:00000080:2.0:1788832979.329268:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788832979.329277:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832979.329280:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.329282:0:5836:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788832979.329285:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832979.329289:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.329290:0:5836:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788832979.329293:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832979.329307:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001601a82c) 00000020:00000080:2.0:1788832979.329318:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788832979.329323:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788832979.329324:0:5836:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788832979.329327:0:5836:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788832979.329332:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788832979.329376:0:5836:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001563091c from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788832979.329387:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000943125be) 00000020:00000080:2.0:1788832979.329394:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788832979.329438:0:5836:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788832979.329443:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3fe701 00000020:00000080:2.0:1788832979.329564:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788832979.329570:0:5836:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788832979.329575:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8c08e876ed3fe708 00080000:01000000:2.0:1788832979.329580:0:5836:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788832979.329582:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3fe70f 00080000:10000000:2.0:1788832979.329923:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788832979.330150:0:5836:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788832979.337240:0:5836:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788832979.426133:0:5836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788832979.426474:0:5836:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788832979.437766:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788832979.438086:0:5836:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788832979.492094:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d52f90d9) 00000020:00000080:2.0:1788832979.492116:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788832979.492605:0:5836:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788832979.492614:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3fe71d 00000020:00000080:2.0:1788832979.495951:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788832979.507854:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788832979.564697:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788832979.604692:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832979.634099:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832979.666717:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832979.700765:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788832979.773721:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8c08e876ed3fe724 00000020:00000080:2.0:1788832979.774781:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788832979.774793:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832979.774798:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.774800:0:5836:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788832979.774803:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832979.774808:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.774809:0:5836:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788832979.774813:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788832979.774849:0:5836:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788832979.774862:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832979.774865:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.774866:0:5836:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788832979.774868:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832979.774871:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.774872:0:5836:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788832979.774875:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788832979.774876:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788832979.774929:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5836:1875727265826048:0@lo:502: 00000100:00100000:2.0:1788832979.775006:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832979.775064:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826048 00000100:00100000:3.0:1788832979.775071:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826048 00000100:00100000:2.0:1788832979.775091:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc0f42f0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832979.775119:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832979.775127:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038983f59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5836:x1875727265826048:12345-0@lo:502: 00000100:00100000:3.0:1788832979.775701:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038983f59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5836:x1875727265826048:12345-0@lo:502: Request processed in 574us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832979.775716:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832979.776441:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5836:1875727265826048:0@lo:502: 00000020:01000000:2.0:1788832979.776472:0:5836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832979.776479:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832979.776481:0:5836:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788832979.776484:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788832979.776660:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788832979.776679:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788832979.776702:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 00000000362352f4/0x8c08e876ed3fe6d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.776713:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 00000000362352f4/0x8c08e876ed3fe6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832979.776730:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea100dd800 from 1 10000000:01000000:0.0:1788832979.776733:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832979.776777:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.776785:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.776794:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832979.776811:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4147574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826176:0@lo:101: 00000100:00100000:0.0:1788832979.776856:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.776898:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f1a5c85 going to sleep for 11 seconds 00000100:00100000:3.0:1788832979.777283:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826176 00000100:00100000:3.0:1788832979.777291:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826176 00000100:00100000:2.0:1788832979.777376:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832979.777386:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bc51ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:5793:x1875727265826176:12345-0@lo:101: 00010000:00010000:2.0:1788832979.777397:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832979.777417:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe72b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.777437:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.777447:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.777454:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5b41ac8, rc 0) 00000100:00100000:2.0:1788832979.777502:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bc51ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:5793:x1875727265826176:12345-0@lo:101: Request processed in 119us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832979.777517:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788832979.777566:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4147574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826176:0@lo:101: 00010000:00010000:0.0:1788832979.777588:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.777597:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832979.778273:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4147574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826304:0@lo:256: 00000100:00100000:0.0:1788832979.778322:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.778358:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f1a5c85 going to sleep for 11 seconds 00000100:00100000:3.0:1788832979.778570:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826304 00000100:00100000:3.0:1788832979.778586:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826304 00000100:00100000:3.0:1788832979.778623:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832979.778629:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bfbbff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:5793:x1875727265826304:12345-0@lo:256: 20000000:01000000:3.0:1788832979.778642:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788832979.778647:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788832979.778726:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bfbbff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:5793:x1875727265826304:12345-0@lo:256: Request processed in 97us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.778732:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4147574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826304:0@lo:256: 00000100:00100000:3.0:1788832979.778733:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:1.0:1788832979.780805:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788832979.780884:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.780924:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832979.782013:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea100dd800 from 1 10000000:01000000:0.0:1788832979.782020:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832979.782101:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.782121:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.782143:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832979.782165:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826432:0@lo:101: 00000100:00100000:0.0:1788832979.782228:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.782264:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f1a5c85 going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.783110:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826432 00000100:00100000:1.0:1788832979.783126:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826432 00000100:00100000:1.0:1788832979.783279:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832979.783287:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b9ca09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:5793:x1875727265826432:12345-0@lo:101: 00010000:00010000:1.0:1788832979.783300:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832979.783313:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe739 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.783335:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.783344:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.783363:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b44621f2, rc 0) 00000100:00100000:1.0:1788832979.783406:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b9ca09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5793:x1875727265826432:12345-0@lo:101: Request processed in 120us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.783412:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788832979.783812:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826432:0@lo:101: 00010000:00010000:0.0:1788832979.783827:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.783835:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832979.783890:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826560:0@lo:501: 00000100:00100000:0.0:1788832979.783994:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.784048:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f1a5c85 going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.784108:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826560 00000100:00100000:1.0:1788832979.784113:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826560 00000100:00100000:1.0:1788832979.784266:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832979.784274:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008554b49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5793:x1875727265826560:12345-0@lo:501: 00000100:00100000:1.0:1788832979.784852:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008554b49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5793:x1875727265826560:12345-0@lo:501: Request processed in 579us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.784869:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788832979.785486:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826560:0@lo:501: 00000100:00100000:0.0:1788832979.785535:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826688:0@lo:503: 00000100:00100000:0.0:1788832979.785584:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.785619:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f1a5c85 going to sleep for 11 seconds 00000100:00100000:3.0:1788832979.785696:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826688 00000100:00100000:3.0:1788832979.785702:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826688 00000100:00100000:3.0:1788832979.785744:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832979.785752:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c16db1dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5793:x1875727265826688:12345-0@lo:503: 00000040:00080000:3.0:1788832979.785792:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788832979.785834:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c16db1dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5793:x1875727265826688:12345-0@lo:503: Request processed in 84us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832979.785841:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832979.786004:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826688:0@lo:503: 00000040:00080000:2.0:1788832979.787730:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788832979.787964:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788832979.787997:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832979.788014:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.788027:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832979.788108:0:5793:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832979.788111:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cea100dd800 10000000:01000000:0.0:1788832979.788114:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cea100dd800 10000000:01000000:0.0:1788832979.788117:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832979.788122:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea100dd800 from 1 10000000:01000000:0.0:1788832979.788124:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832979.788163:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 000000003e388184/0x8c08e876ed3fe747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.788171:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 000000003e388184/0x8c08e876ed3fe747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.788179:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 000000003e388184/0x8c08e876ed3fe747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832979.788198:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826816:0@lo:101: 00000100:00100000:0.0:1788832979.788257:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.788298:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 00000000955a0d39 going to sleep for 11 seconds 00000100:00100000:1.0:1788832979.788299:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826816 00000100:00100000:1.0:1788832979.788305:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826816 00000100:00100000:1.0:1788832979.788345:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788832979.788365:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050d3aba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5793:x1875727265826816:12345-0@lo:101: 00010000:00010000:1.0:1788832979.788376:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832979.788389:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9fe6ac2/0x8c08e876ed3fe74e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe747 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.788409:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9fe6ac2/0x8c08e876ed3fe74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.788419:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9fe6ac2/0x8c08e876ed3fe74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832979.788435:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9fe6ac2, rc 0) 00000100:00100000:1.0:1788832979.789004:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050d3aba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5793:x1875727265826816:12345-0@lo:101: Request processed in 640us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832979.789012:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832979.792294:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008c24699 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826816:0@lo:101: 00010000:00010000:3.0:1788832979.792322:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 000000003e388184/0x8c08e876ed3fe747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.792334:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 000000003e388184/0x8c08e876ed3fe747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832979.792440:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c7e874b pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826944:0@lo:501: 00000100:00100000:3.0:1788832979.792501:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832979.792555:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0d52cc8 going to sleep for 11 seconds 00000100:00100000:0.0:1788832979.792668:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265826944 00000100:00100000:0.0:1788832979.792675:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265826944 00000100:00100000:0.0:1788832979.792722:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788832979.792730:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000855fa77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5793:x1875727265826944:12345-0@lo:501: 00000100:00100000:0.0:1788832979.792983:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000855fa77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5793:x1875727265826944:12345-0@lo:501: Request processed in 252us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832979.792996:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788832979.793006:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c7e874b pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265826944:0@lo:501: 00000100:00100000:1.0:1788832979.793052:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b43f9e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265827072:0@lo:503: 00000100:00100000:1.0:1788832979.793090:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832979.793112:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099a7e556 going to sleep for 11 seconds 00000100:00100000:0.0:1788832979.793264:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827072 00000100:00100000:0.0:1788832979.793269:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827072 00000100:00100000:0.0:1788832979.793298:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832979.793304:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d2e49f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5793:x1875727265827072:12345-0@lo:503: 00000100:00100000:0.0:1788832979.793593:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d2e49f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5793:x1875727265827072:12345-0@lo:503: Request processed in 289us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832979.793600:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788832979.793733:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b43f9e62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265827072:0@lo:503: 00000100:00100000:1.0:1788832979.804327:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b43f9e62 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5841:1875727265827200:0@lo:502: 00000100:00100000:1.0:1788832979.804518:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832979.804614:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090d2c09a going to sleep for 11 seconds 00000100:00100000:0.0:1788832979.805899:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827200 00000100:00100000:0.0:1788832979.805910:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827200 00000100:00100000:0.0:1788832979.806086:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788832979.806097:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000490bfb79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5841:x1875727265827200:12345-0@lo:502: 00000100:00100000:0.0:1788832979.806546:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000490bfb79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5841:x1875727265827200:12345-0@lo:502: Request processed in 451us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832979.806556:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788832979.806575:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b43f9e62 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5841:1875727265827200:0@lo:502: 00000020:01000004:1.0:1788832979.806643:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788832979.806667:0:5841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008eb2243b) 00000020:00000080:1.0:1788832979.806685:0:5841:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788832979.806757:0:5841:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001563091c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788832979.806760:0:5841:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001563091c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788832979.806763:0:5841:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001563091c 4 00010000:00080000:1.0:1788832979.806788:0:5841:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004423f5ea@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1788832979.808394:0:5841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788832979.808588:0:5841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788832979.808622:0:5841:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788832979.808635:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8c08e876ed3fe75c 00000100:00080000:1.0:1788832979.808645:0:5841:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832979.808649:0:5841:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004423f5ea using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1788832979.808696:0:5841:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b43f9e62 x1875727265827328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832979.808726:0:5841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788832979.809072:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b43f9e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265827328:0@lo:38: 00000100:00100000:3.0:1788832979.809134:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832979.811078:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827328 00000100:00100000:1.0:1788832979.811089:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827328 00000100:00100000:1.0:1788832979.811274:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832979.811280:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc75e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875727265827328:12345-0@lo:38: 00000100:00100000:1.0:1788832979.811377:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc75e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875727265827328:12345-0@lo:38: Request processed in 95us (2242us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788832979.811384:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832979.811485:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788832979.811493:0:3275:0:(import.c:65:import_set_state_nolock()) 000000004423f5ea lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832979.811497:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788832979.811500:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b43f9e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265827328:0@lo:38: 00000100:00100000:1.0:1788832979.811825:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001d2f48e pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5841:1875727265827456:0@lo:502: 00000100:00100000:1.0:1788832979.811876:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832979.811923:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b73463e8 going to sleep for 11 seconds 00000100:00100000:0.0:1788832979.812231:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827456 00000100:00100000:0.0:1788832979.812237:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827456 00000100:00100000:0.0:1788832979.812272:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832979.812279:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000375ebec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5841:x1875727265827456:12345-0@lo:502: 00000100:00100000:0.0:1788832979.812487:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000375ebec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5841:x1875727265827456:12345-0@lo:502: Request processed in 209us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832979.812494:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788832979.812816:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001d2f48e pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5841:1875727265827456:0@lo:502: 00000040:00080000:1.0:1788832979.812840:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788832979.813471:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788832979.813496:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788832979.813518:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 000000003e388184/0x8c08e876ed3fe747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832979.813530:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 000000003e388184/0x8c08e876ed3fe747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788832979.813575:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788832979.813578:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788832979.813579:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832979.813580:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832979.813585:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832979.813586:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832979.813588:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832979.813589:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788832979.813590:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832979.813591:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832979.813592:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832979.813594:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788832979.813597:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788832979.813600:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788832979.813601:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788832979.813601:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832979.813602:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832979.813603:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832979.813604:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832979.813605:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832979.813605:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788832979.813606:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832979.813607:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832979.813608:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832979.813609:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788832979.813627:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788832979.813638:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265827584:0@lo:253: 00000100:00100000:2.0:1788832979.813683:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832979.813709:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6dd90e2 going to sleep for 11 seconds 00000100:00100000:0.0:1788832979.815179:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827584 00000100:00100000:0.0:1788832979.815189:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827584 00000100:00100000:0.0:1788832979.815231:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832979.815239:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a63de2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5793:x1875727265827584:12345-0@lo:253: 20000000:01000000:0.0:1788832979.815278:0:5806:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788832979.815290:0:5806:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788832979.862501:0:5806:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788832979.862569:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788832979.865987:0:5828:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788832979.865997:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788832979.866017:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.866052:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.866061:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.866100:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.866115:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 12 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832979.866127:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dab156a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1875727265827712:0@lo:104: 00000100:00100000:3.0:1788832979.866195:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832979.866250:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075f4d597 going to sleep for 11 seconds 00000100:00100000:0.0:1788832979.866908:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827712 00000100:00100000:0.0:1788832979.866917:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827712 00000100:00100000:0.0:1788832979.866964:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832979.866972:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d069b69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5828:x1875727265827712:12345-0@lo:104: 00010000:00010000:0.0:1788832979.866984:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867071:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788832979.867076:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d069b69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5828:x1875727265827712:12345-0@lo:104: Request processed in 105us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832979.867082:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788832979.867100:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832979.867105:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867113:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000331efeed already unused, calling callback (000000006aac70be) 10000000:00010000:0.0:1788832979.867115:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867123:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832979.867128:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832979.867134:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832979.867172:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867190:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832979.867205:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867211:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: 00000000331efeed/0x8c08e876ed3fe72b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe732 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867226:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832979.867228:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832979.867229:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832979.867359:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dab156a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1875727265827712:0@lo:104: 00010000:00010000:3.0:1788832979.867378:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832979.867494:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bb12f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265827840:0@lo:103: 00000100:00100000:2.0:1788832979.867537:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832979.867844:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827840 00000100:00100000:0.0:1788832979.867849:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827840 00010000:00010000:0.0:1788832979.867865:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832979.867897:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832979.867902:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077f3ab6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3277:x1875727265827840:12345-0@lo:103: 00010000:00010000:0.0:1788832979.867912:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832979.867916:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867925:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867936:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d5b41ac8/0x8c08e876ed3fe732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe72b expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867949:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867966:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788832979.867978:0:5797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001981656s 00010000:00010000:0.0:1788832979.867982:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867988:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867994:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.867999:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.868004:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e1c5036 already unused, calling callback (000000008264ce99) 00010000:00010000:0.0:1788832979.868006:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.868012:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.868028:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832979.868066:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832979.868096:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077f3ab6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3277:x1875727265827840:12345-0@lo:103: Request processed in 194us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832979.868102:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788832979.868174:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.868191:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832979.868197:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe763 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832979.868315:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bb12f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265827840:0@lo:103: 00000100:00100000:0.0:1788832979.873950:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a63de2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5793:x1875727265827584:12345-0@lo:253: Request processed in 58705us (60260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832979.873965:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832979.874258:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0fa1be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5793:1875727265827584:0@lo:253: 10000000:01000000:3.0:1788832979.874272:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788832979.874275:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788832979.874277:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788832979.874279:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832979.874280:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832979.874281:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832979.874282:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832979.874283:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788832979.874284:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788832979.874286:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832979.874287:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832979.874288:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832979.874290:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788832979.874302:0:5793:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788832979.882099:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832979.882851:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788832979.883096:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832979.883489:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788832979.883800:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832979.883981:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788832979.885257:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832979.885692:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788832979.885885:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832979.886144:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788832979.886667:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832979.886852:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788832979.933301:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1788832979.951092:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788832979.971906:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788832979.972130:0:5846:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788832979.972135:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788832979.972289:0:5847:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788832979.978103:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788832979.978293:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788832979.982203:0:5793:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788832979.982222:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788832979.982533:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832979.983525:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788832979.984085:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788832979.984115:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788832979.984349:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788832979.984571:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788832979.987860:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788832979.988026:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788832979.988192:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788832979.988354:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788832979.988487:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788832979.988639:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788832979.988767:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788832979.988906:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788832979.989110:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788832979.989258:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788832979.989385:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788832979.989532:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788832979.989853:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788832979.990002:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788832979.990181:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788832979.990606:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788832979.990892:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788832979.991103:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788832979.991243:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788832979.991473:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788832979.991619:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788832979.991783:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788832979.991941:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788832979.992135:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788832979.992294:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788832979.992642:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788832979.992788:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788832979.992965:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788832979.993458:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788832979.993638:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788832979.993766:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788832979.993910:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788832979.994143:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788832980.010145:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788832980.047734:0:5793:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788832980.047771:0:5793:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb42c01cb7988 00100000:10000000:3.0:1788832980.047779:0:5793:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788832980.048494:0:5793:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788832980.048519:0:5793:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788832980.048536:0:5793:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788832980.048552:0:5793:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788832980.064247:0:5847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788832980.064321:0:5847:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788832980.064325:0:5847:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788832980.975413:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832981.998539:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832983.026950:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788832983.978218:0:6089:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788832984.046466:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832985.070292:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832985.197498:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001d2f48e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265827968:0@lo:400: 00000100:00100000:3.0:1788832985.197583:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832985.198095:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265827968 00000100:00100000:0.0:1788832985.198103:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265827968 00000100:00100000:0.0:1788832985.198139:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832985.198146:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d11ac89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:3278:x1875727265827968:12345-0@lo:400: 00000100:00080000:1.0:1788832985.198230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788832985.198236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788832985.198238:0:36:0:(import.c:65:import_set_state_nolock()) 000000004423f5ea lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832985.198246:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004423f5ea using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1788832985.202441:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d11ac89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:3278:x1875727265827968:12345-0@lo:400: Request processed in 4286us (4849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832985.202457:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832985.202559:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000962cb945 x1875727265828096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832985.202598:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000962cb945 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265828096:0@lo:38: 00000100:00100000:0.0:1788832985.202648:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832985.204814:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828096 00000100:00100000:1.0:1788832985.204826:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828096 00000100:00100000:1.0:1788832985.204860:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832985.204866:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cbd5c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3275:x1875727265828096:12345-0@lo:38: 00010000:00080000:1.0:1788832985.204890:0:5813:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:1.0:1788832985.204923:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8c08e876ed3fe76a 00000004:00100000:1.0:1788832985.204961:0:5813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788832985.205083:0:5813:0:(import.c:65:import_set_state_nolock()) 00000000fb44fed9 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832985.205152:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cbd5c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875727265828096:12345-0@lo:38: Request processed in 285us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832985.205159:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788832985.205202:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000962cb945 x1875727265828096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788832985.205216:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788832985.205230:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788832985.205234:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788832985.205236:0:3275:0:(import.c:65:import_set_state_nolock()) 000000004423f5ea lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788832985.205242:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000962cb945 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265828096:0@lo:38: 00000100:00100000:3.0:1788832985.205376:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001d2f48e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265827968:0@lo:400: 00010000:00010000:1.0:1788832986.093429:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832987.117239:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832988.141222:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788832988.536940:0:6291:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8a0fe810 20000000:00000080:3.0:1788832988.536969:0:6291:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cea06672800 uarg=0000000000000000 20000000:01000000:3.0:1788832988.537015:0:6291:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788832988.537024:0:6291:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788832988.537155:0:6291:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788832988.537402:0:6291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788832988.537418:0:6291:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788832988.542375:0:6291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832988.542778:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788832988.542842:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788832988.542895:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788832988.542915:0:6291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788832988.542939:0:6291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.542963:0:6291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.542971:0:6291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.543020:0:6291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.543078:0:6291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 10 pid: 5807 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832988.543097:0:6291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dab156a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6291:1875727265828224:0@lo:104: 00000100:00100000:3.0:1788832988.543181:0:6291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832988.543253:0:6291:0:(client.c:2715:ptlrpc_set_wait()) set 00000000647fb488 going to sleep for 11 seconds 00000100:00100000:2.0:1788832988.543517:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828224 00000100:00100000:2.0:1788832988.543529:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828224 00000100:00100000:2.0:1788832988.543694:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832988.543705:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004010751d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:6291:x1875727265828224:12345-0@lo:104: 00010000:00010000:2.0:1788832988.543721:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.543813:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832988.543820:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004010751d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:6291:x1875727265828224:12345-0@lo:104: Request processed in 117us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832988.543828:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832988.544248:0:6291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dab156a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6291:1875727265828224:0@lo:104: 00010000:00010000:1.0:1788832988.544276:0:6291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.544672:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832988.544680:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.544689:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000720cfe64 already unused, calling callback (000000006aac70be) 10000000:00010000:2.0:1788832988.544693:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.544703:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832988.544710:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832988.544716:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832988.544768:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.544776:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832988.544806:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.544813:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: 00000000720cfe64/0x8c08e876ed3fe739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe740 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.544846:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832988.544847:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832988.544849:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832988.544898:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001edc1a2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265828352:0@lo:103: 00000100:00100000:3.0:1788832988.544960:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788832988.545112:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832988.545118:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea100dd800 from 3 10000000:01000000:0.0:1788832988.545122:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832988.545150:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 0000000058914bdb/0x8c08e876ed3fe778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832988.545159:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 0000000058914bdb/0x8c08e876ed3fe778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832988.545169:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 0000000058914bdb/0x8c08e876ed3fe778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832988.545184:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c3c3a8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828480:0@lo:101: 00000100:00100000:0.0:1788832988.545218:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832988.545252:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4d8793d going to sleep for 11 seconds 00000100:00100000:3.0:1788832988.546174:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828480 00000100:00100000:3.0:1788832988.546185:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828480 00000100:00100000:3.0:1788832988.546247:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832988.546256:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b27b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5809:x1875727265828480:12345-0@lo:101: 00010000:00010000:3.0:1788832988.546273:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832988.546292:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000207dfef5/0x8c08e876ed3fe77f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe778 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.546394:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000207dfef5/0x8c08e876ed3fe77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.546407:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000207dfef5/0x8c08e876ed3fe77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.546417:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000207dfef5, rc 0) 00000100:00100000:3.0:1788832988.546501:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b27b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265828480:12345-0@lo:101: Request processed in 246us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832988.546509:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832988.546614:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c3c3a8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828480:0@lo:101: 00010000:00010000:3.0:1788832988.547439:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 0000000058914bdb/0x8c08e876ed3fe778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.547455:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 0000000058914bdb/0x8c08e876ed3fe778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832988.547550:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d568e40c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828608:0@lo:256: 00000100:00100000:3.0:1788832988.547612:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832988.547823:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828352 00000100:00100000:2.0:1788832988.547832:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828352 00010000:00010000:2.0:1788832988.547867:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 12 pid: 5807 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832988.547900:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832988.548452:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae2fb436 going to sleep for 11 seconds 00000100:00100000:2.0:1788832988.549445:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9059da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3279:x1875727265828352:12345-0@lo:103: 00010000:00010000:2.0:1788832988.549480:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832988.549489:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 12 pid: 5807 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549507:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 12 pid: 5807 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549528:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b44621f2/0x8c08e876ed3fe740 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe739 expref: 12 pid: 5807 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549549:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549558:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549577:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549583:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549606:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549613:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549620:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e1c5036 already unused, calling callback (000000008264ce99) 00010000:00010000:2.0:1788832988.549624:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549632:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549660:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832988.549672:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832988.549753:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9059da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:3279:x1875727265828352:12345-0@lo:103: Request processed in 325us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832988.549761:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832988.550552:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001edc1a2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265828352:0@lo:103: 00010000:00010000:1.0:1788832988.551451:0:6291:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832988.551477:0:6291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832988.551483:0:6291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e1c5036/0x8c08e876ed3fe771 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832988.557833:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828608 00000100:00100000:0.0:1788832988.557858:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828608 00000100:00100000:0.0:1788832988.557954:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832988.557964:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f113aa9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5809:x1875727265828608:12345-0@lo:256: 20000000:01000000:0.0:1788832988.557999:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788832988.558051:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788832988.558055:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788832988.558245:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f113aa9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5809:x1875727265828608:12345-0@lo:256: Request processed in 282us (10633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832988.558254:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788832988.559809:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d568e40c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828608:0@lo:256: 10000000:01000000:3.0:1788832988.559901:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788832988.559913:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 0000000058914bdb/0x8c08e876ed3fe778 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.559926:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 0000000058914bdb/0x8c08e876ed3fe778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832988.559938:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832988.559941:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea100dd800 from 1 10000000:01000000:3.0:1788832988.559944:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832988.559988:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 00000000b54c9b47/0x8c08e876ed3fe786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.559995:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 00000000b54c9b47/0x8c08e876ed3fe786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.560005:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 00000000b54c9b47/0x8c08e876ed3fe786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832988.560024:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d568e40c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828736:0@lo:101: 00000100:00100000:3.0:1788832988.560933:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832988.560995:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae2fb436 going to sleep for 11 seconds 00000100:00100000:0.0:1788832988.561141:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828736 00000100:00100000:0.0:1788832988.561151:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828736 00000100:00100000:0.0:1788832988.561212:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788832988.561222:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079dd9f1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:5809:x1875727265828736:12345-0@lo:101: 00010000:00010000:0.0:1788832988.561239:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832988.561273:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a69cbb9/0x8c08e876ed3fe78d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe786 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832988.561302:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a69cbb9/0x8c08e876ed3fe78d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832988.561421:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a69cbb9/0x8c08e876ed3fe78d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832988.561431:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a69cbb9, rc 0) 00000100:00100000:0.0:1788832988.561498:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079dd9f1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265828736:12345-0@lo:101: Request processed in 278us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832988.561505:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788832988.563524:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d568e40c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828736:0@lo:101: 00010000:00010000:3.0:1788832988.563560:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 00000000b54c9b47/0x8c08e876ed3fe786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.563575:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 00000000b54c9b47/0x8c08e876ed3fe786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832988.563750:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d568e40c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828864:0@lo:501: 00000100:00100000:3.0:1788832988.563835:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832988.563928:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae2fb436 going to sleep for 11 seconds 00000100:00100000:1.0:1788832988.571198:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828864 00000100:00100000:1.0:1788832988.571217:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828864 00000100:00100000:1.0:1788832988.571382:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788832988.571394:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000770601ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265828864:12345-0@lo:501: 00000100:00100000:1.0:1788832988.573227:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000770601ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265828864:12345-0@lo:501: Request processed in 1826us (9383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832988.573243:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832988.579443:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d568e40c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828864:0@lo:501: 00000100:00100000:0.0:1788832988.582353:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8cd6a2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828992:0@lo:503: 00000100:00100000:0.0:1788832988.582474:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832988.582523:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265828992 00000100:00100000:0.0:1788832988.582531:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265828992 00000100:00100000:0.0:1788832988.582587:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832988.582596:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c557ddb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265828992:12345-0@lo:503: 00000100:00100000:0.0:1788832988.582816:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c557ddb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265828992:12345-0@lo:503: Request processed in 220us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832988.582825:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832988.582896:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dc507bb going to sleep for 11 seconds 00000100:00100000:0.0:1788832988.582921:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8cd6a2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265828992:0@lo:503: 00000100:00100000:0.0:1788832988.584341:0:6293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8cd6a2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6293:1875727265829120:0@lo:502: 00000100:00100000:0.0:1788832988.584433:0:6293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832988.584497:0:6293:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c09672ba going to sleep for 11 seconds 00000100:00100000:3.0:1788832988.584606:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265829120 00000100:00100000:3.0:1788832988.584614:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265829120 00000100:00100000:3.0:1788832988.584678:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788832988.584688:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f3e4efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6293:x1875727265829120:12345-0@lo:502: 00000100:00100000:3.0:1788832988.584907:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f3e4efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6293:x1875727265829120:12345-0@lo:502: Request processed in 220us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832988.584915:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832988.585182:0:6293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8cd6a2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6293:1875727265829120:0@lo:502: 00000020:01000000:0.0:1788832988.585224:0:6293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832988.585235:0:6293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832988.585237:0:6293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788832988.585244:0:6293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea100dd800 00000020:00000080:0.0:1788832988.585246:0:6293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788832988.585292:0:6293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6293:1875727265829248:0@lo:502: 00000100:00100000:0.0:1788832988.585346:0:6293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832988.585372:0:6293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832988.585503:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265829248 00000100:00100000:3.0:1788832988.585509:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265829248 00000100:00100000:3.0:1788832988.585538:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788832988.585546:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6293:x1875727265829248:12345-0@lo:502: 00000100:00100000:3.0:1788832988.585690:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6293:x1875727265829248:12345-0@lo:502: Request processed in 145us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832988.585698:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788832988.585913:0:6293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6293:1875727265829248:0@lo:502: 00000020:01000000:0.0:1788832988.585938:0:6293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832988.585943:0:6293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832988.585945:0:6293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788832988.585949:0:6293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788832988.586182:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788832988.586208:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832988.586220:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832988.586234:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832989.172478:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832990.189177:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832990.321250:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265829504:0@lo:400: 00000100:00100000:3.0:1788832990.321419:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832990.321692:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832990.321701:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265829376:0@lo:400: 00000100:00100000:3.0:1788832990.321735:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832990.321933:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265829376 00000100:00100000:3.0:1788832990.321943:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265829376 00000100:00100000:2.0:1788832990.321967:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265829504 00000100:00100000:2.0:1788832990.321983:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265829504 00000100:00100000:3.0:1788832990.322012:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788832990.322029:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3277:x1875727265829376:12345-0@lo:400: 00000100:00100000:2.0:1788832990.322111:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832990.322126:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265829504:12345-0@lo:400: 00000100:00100000:2.0:1788832990.322230:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265829504:12345-0@lo:400: Request processed in 108us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832990.322251:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832990.322283:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3277:x1875727265829376:12345-0@lo:400: Request processed in 256us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832990.322410:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265829376:0@lo:400: 00010000:00080000:2.0:1788832990.322439:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cea05caa680 x1875727265829504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832990.322466:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265829504:0@lo:400: 00000100:00100000:3.0:1788832990.322925:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788832991.213203:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832992.237269:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832993.261188:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832994.288786:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788832995.105917:0:6651:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788832995.105922:0:6651:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788832995.106411:0:6651:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cea1fc5c800 00000020:01000004:2.0:1788832995.106436:0:6651:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788832995.106448:0:6651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788832995.106462:0:6651:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cea1f78b370) 00000020:00000080:2.0:1788832995.106477:0:6651:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788832995.124987:0:6651:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788832995.125526:0:6651:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788832995.161004:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788832995.201260:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788832995.201294:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788832995.201351:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788832995.201377:0:6651:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788832995.201720:0:6651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788832995.201731:0:6651:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788832995.201741:0:6651:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c08e876ed3fe79b 00000020:01000004:3.0:1788832995.201749:0:6651:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788832995.201771:0:6651:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.155@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788832995.201775:0:6651:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788832995.201781:0:6651:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788832995.201785:0:6651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788832995.201796:0:6651:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cea069919b8) 00000020:00000080:3.0:1788832995.201806:0:6651:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788832995.204396:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832995.204588:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788832995.204594:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788832995.206584:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788832995.206594:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788832995.207958:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788832995.207968:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788832995.209471:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832995.209655:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788832995.209661:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788832995.210260:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788832995.210267:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788832995.250147:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832995.252569:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788832995.252580:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788832995.254081:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788832995.254094:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788832995.257472:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788832995.257493:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788832995.263598:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832995.263791:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788832995.263797:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788832995.267409:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788832995.267420:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1788832995.309256:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832995.341545:0:6651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832995.343583:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788832995.343594:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788832995.346663:0:6651:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788832995.346678:0:6651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788832995.348633:0:6651:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788832995.348658:0:6651:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788832995.348664:0:6651:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788832995.398132:0:6651:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788832995.398178:0:6651:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.155@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788832995.398182:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788832995.398184:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832995.398186:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832995.398187:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832995.398188:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832995.398189:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832995.398191:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832995.398193:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832995.398194:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832995.398195:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832995.398197:0:6651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788832995.398201:0:6651:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788832995.398203:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832995.398204:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832995.398205:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832995.398207:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832995.398208:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832995.398209:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832995.398210:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832995.398211:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832995.398212:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832995.398213:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832995.398214:0:6651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788832995.398251:0:6651:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788832995.398286:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265829632:0@lo:253: 00000100:00100000:1.0:1788832995.398363:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.398437:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea202c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832995.398462:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265829632 00000100:00100000:3.0:1788832995.398471:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265829632 00000100:00100000:3.0:1788832995.398523:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788832995.398533:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265829632:12345-0@lo:253: 20000000:01000000:3.0:1788832995.398573:0:5804:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788832995.398577:0:5804:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788832995.398582:0:5804:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788832995.398586:0:5804:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788832995.399592:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832995.399802:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788832995.399815:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788832995.399867:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788832995.399875:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788832995.399906:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788832995.399957:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788832995.400401:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788832995.400421:0:5804:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.155@tcp 20000000:01000000:3.0:1788832995.400423:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788832995.400472:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788832995.400481:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788832995.400527:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788832995.400535:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.155@tcp (null) (null) 00000040:00080000:3.0:1788832995.400568:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788832995.400576:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788832995.400604:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788832995.400673:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788832995.403440:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788832995.403473:0:5804:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.155@tcp 20000000:01000000:3.0:1788832995.403476:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788832995.403516:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788832995.403533:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788832995.403569:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788832995.403576:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.155@tcp (null) (null) 00000040:00080000:3.0:1788832995.403619:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788832995.403629:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788832995.403662:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788832995.403694:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788832995.403714:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788832995.403716:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788832995.403720:0:5804:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788832995.403731:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788832995.403734:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788832995.403770:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788832995.403773:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788832995.405603:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788832995.405908:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788832995.405954:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788832995.406025:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788832995.406090:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788832995.406093:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788832995.407984:0:6667:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788832995.408088:0:6667:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788832995.408143:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788832995.410087:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788832995.410139:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788832995.410173:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788832995.410189:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788832995.410192:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788832995.411115:0:6668:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788832995.411176:0:6668:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788832995.411227:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788832995.411631:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788832995.411669:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788832995.411720:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788832995.411737:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788832995.411738:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788832995.411747:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788832995.411765:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.411793:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.411801:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea42166400/0x8c08e876ed3fe6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.411822:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea42167a00/0x8c08e876ed3fe74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.411829:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.411865:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea42167a00/0x8c08e876ed3fe74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.411880:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea42167a00/0x8c08e876ed3fe74e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 12 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.411894:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5804:1875727265829760:0@lo:104: 00000100:00100000:3.0:1788832995.411953:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832995.412191:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea42166400/0x8c08e876ed3fe6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.412200:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea42166400/0x8c08e876ed3fe6de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 12 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.412208:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5804:1875727265829888:0@lo:104: 00000100:00100000:3.0:1788832995.412231:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832995.412511:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.412520:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 12 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.412529:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5804:1875727265830016:0@lo:104: 00000100:00100000:3.0:1788832995.412559:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832995.412679:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265829760 00000100:00100000:2.0:1788832995.412686:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265829760 00000100:00100000:2.0:1788832995.412719:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265829888 00000100:00100000:2.0:1788832995.412722:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265829888 00000100:00100000:2.0:1788832995.412744:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832995.412751:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:5804:x1875727265829760:12345-0@lo:104: 00010000:00010000:2.0:1788832995.412764:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.412887:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832995.412893:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:5804:x1875727265829760:12345-0@lo:104: Request processed in 143us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.412900:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832995.412916:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832995.412922:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5804:x1875727265829888:12345-0@lo:104: 00010000:00010000:2.0:1788832995.412930:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.412963:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832995.412969:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5804:x1875727265829888:12345-0@lo:104: Request processed in 47us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.412974:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788832995.412991:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832995.412996:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413003:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477800 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788832995.413007:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413016:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832995.413053:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832995.413059:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832995.413091:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413097:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832995.413115:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413121:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe74e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413133:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832995.413137:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413142:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517a00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788832995.413144:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413151:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832995.413157:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832995.413163:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832995.413183:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413189:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832995.413195:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413201:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe6d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe6de expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.413210:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832995.413212:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832995.413213:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832995.413236:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265830144:0@lo:103: 00000100:00100000:2.0:1788832995.413262:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832995.413284:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832995.413290:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265830272:0@lo:103: 00010000:00010000:1.0:1788832995.413444:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832995.414111:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832995.414168:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830144 00000100:00100000:2.0:1788832995.414175:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830144 00010000:00010000:2.0:1788832995.414201:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea42167a00/0x8c08e876ed3fe74e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 13 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832995.414223:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830272 00000100:00100000:2.0:1788832995.414226:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830272 00010000:00010000:2.0:1788832995.414236:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea42166400/0x8c08e876ed3fe6de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 14 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832995.414249:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832995.414255:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3278:x1875727265830144:12345-0@lo:103: 00010000:00010000:2.0:1788832995.414282:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832995.414287:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea42167a00/0x8c08e876ed3fe74e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 14 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.414297:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea42167a00/0x8c08e876ed3fe74e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 14 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.414325:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832995.414359:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3278:x1875727265830144:12345-0@lo:103: Request processed in 104us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.414365:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832995.414380:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832995.414387:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3278:x1875727265830272:12345-0@lo:103: 00010000:00010000:2.0:1788832995.414394:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832995.414399:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea42166400/0x8c08e876ed3fe6de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 13 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.414407:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea42166400/0x8c08e876ed3fe6de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 13 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.414416:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832995.414447:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3278:x1875727265830272:12345-0@lo:103: Request processed in 61us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.414453:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832995.414488:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265830272:0@lo:103: 00000100:00100000:2.0:1788832995.414495:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265830144:0@lo:103: 00000100:00100000:3.0:1788832995.415071:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324180 going to sleep for 11 seconds 00010000:00010000:3.0:1788832995.415089:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea42167a00/0x8c08e876ed3fe74e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe747 expref: 12 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.415102:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5804:1875727265829760:0@lo:104: 00010000:00010000:3.0:1788832995.415113:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea42166400/0x8c08e876ed3fe6de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe6d7 expref: 11 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.415125:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5804:1875727265829888:0@lo:104: 00000100:00100000:2.0:1788832995.415313:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830016 00000100:00100000:2.0:1788832995.415319:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830016 00000100:00100000:2.0:1788832995.415354:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788832995.415361:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5804:x1875727265830016:12345-0@lo:104: 00010000:00010000:2.0:1788832995.415372:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.415442:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832995.415448:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5804:x1875727265830016:12345-0@lo:104: Request processed in 88us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.415454:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788832995.415509:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832995.415515:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.415523:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea42166600 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:1.0:1788832995.415527:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.415546:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832995.415554:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832995.415560:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832995.415598:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.415604:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832995.415622:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.415628:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe6bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe6c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.415644:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832995.415646:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832995.415648:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832995.415695:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5804:1875727265830016:0@lo:104: 00010000:00010000:3.0:1788832995.415715:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832995.415758:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832995.415779:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265830400:0@lo:103: 00000100:00100000:2.0:1788832995.415813:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832995.415950:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830400 00000100:00100000:3.0:1788832995.415954:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830400 00010000:00010000:3.0:1788832995.415972:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 11 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.415999:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832995.416006:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:3277:x1875727265830400:12345-0@lo:103: 00010000:00010000:3.0:1788832995.416015:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832995.416019:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 11 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416063:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 11 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416076:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe6c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe6bb expref: 11 pid: 5804 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416095:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416102:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416114:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416121:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416128:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416134:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416140:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788832995.416143:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416150:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416162:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.416171:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832995.416200:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:3277:x1875727265830400:12345-0@lo:103: Request processed in 194us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.416215:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788832995.416282:0:5804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.416289:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.416295:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe7a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832995.416309:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788832995.419235:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265830400:0@lo:103: 00000100:00100000:1.0:1788832995.441328:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832995.441353:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265830528:0@lo:400: 00000100:00100000:1.0:1788832995.441419:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.441492:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830528 00000100:00100000:1.0:1788832995.441500:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830528 00000100:00100000:1.0:1788832995.441542:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832995.441550:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265830528:12345-0@lo:400: 00000100:00100000:1.0:1788832995.441597:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265830528:12345-0@lo:400: Request processed in 47us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832995.441603:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788832995.441640:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cea05cab800 x1875727265830528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832995.441653:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265830528:0@lo:400: 00000100:00100000:2.0:1788832995.532794:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:6651:x1875727265829632:12345-0@lo:253: Request processed in 134253us (134421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.532808:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788832995.533128:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265829632:0@lo:253: 10000000:01000000:1.0:1788832995.533146:0:6651:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788832995.533151:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832995.533152:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832995.533153:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832995.533154:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788832995.533156:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832995.533157:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832995.533159:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832995.533160:0:6651:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788832995.533162:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832995.533163:0:6651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788832995.533190:0:6651:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cea1fc5c800 from lustre-OST0000 10000000:01000000:1.0:1788832995.533219:0:6651:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788832995.533222:0:6651:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788832995.533228:0:6651:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cea10ad4d28 local copy 10000000:01000000:1.0:1788832995.533232:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788832995.533265:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.533288:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.533298:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832995.533317:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265830656:0@lo:101: 00000100:00100000:1.0:1788832995.533444:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.533506:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832995.533576:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830656 00000100:00100000:3.0:1788832995.533584:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830656 00000100:00100000:3.0:1788832995.533624:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832995.533633:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:6651:x1875727265830656:12345-0@lo:101: 00010000:00010000:3.0:1788832995.533656:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832995.533670:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe7b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe7b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.533693:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7b0 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.533703:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7b0 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.533711:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788832995.533755:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:6651:x1875727265830656:12345-0@lo:101: Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.533761:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788832995.534026:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265830656:0@lo:101: 00010000:00010000:1.0:1788832995.534070:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.534079:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832995.534187:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265830784:0@lo:501: 00000100:00100000:1.0:1788832995.534212:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.534227:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832995.534293:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830784 00000100:00100000:3.0:1788832995.534297:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830784 00000100:00100000:3.0:1788832995.534327:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832995.534335:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:6651:x1875727265830784:12345-0@lo:501: 00000100:00100000:3.0:1788832995.534560:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:6651:x1875727265830784:12345-0@lo:501: Request processed in 225us (346us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832995.534567:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788832995.535250:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265830784:0@lo:501: 10000000:01000000:1.0:1788832995.535263:0:6651:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788832995.535306:0:6651:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788832995.535313:0:6651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.535322:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.535399:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.535433:0:6651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788832995.535457:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cea1fc5c800 10000000:01000000:1.0:1788832995.535461:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788832995.535466:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cea10ad4d28 10000000:01000000:1.0:1788832995.535468:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788832995.535472:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cea10ad4d28 from 1 10000000:01000000:1.0:1788832995.535475:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788832995.535498:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.535505:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.535514:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832995.535528:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265830912:0@lo:101: 00000100:00100000:1.0:1788832995.535561:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.535583:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fc240 going to sleep for 11 seconds 00010000:00010000:0.0:1788832995.535745:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832995.535752:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.535760:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea42166600 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:0.0:1788832995.535763:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.535770:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832995.535777:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832995.535783:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832995.535801:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.535807:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832995.535842:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.535849:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c08e876ed3fe7b7 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832995.535946:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265831040:0@lo:103: 00000100:00100000:2.0:1788832995.535979:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832995.536068:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832995.536071:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832995.536073:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832995.536821:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265830912 00000100:00100000:3.0:1788832995.536830:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265830912 00000100:00100000:3.0:1788832995.536899:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788832995.536908:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:6651:x1875727265830912:12345-0@lo:101: 00010000:00010000:3.0:1788832995.536920:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832995.536934:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dd800/0x8c08e876ed3fe7c5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe7be expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.536955:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dd800/0x8c08e876ed3fe7c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7be expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.536966:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dd800/0x8c08e876ed3fe7c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7be expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.536975:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd800, rc 0) 00000100:00100000:3.0:1788832995.537061:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265830912:12345-0@lo:101: Request processed in 154us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.537067:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832995.537271:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265830912:0@lo:101: 00010000:00010000:0.0:1788832995.537286:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7c5 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.537295:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe7c5 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832995.537319:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788832995.537328:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7c5 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.537336:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7c5 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832995.537477:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788832995.537483:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832995.537488:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788832995.537491:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788832995.537511:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.537529:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.537538:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832995.537552:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831168:0@lo:101: 00000100:00100000:0.0:1788832995.537590:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832995.537631:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538900 going to sleep for 11 seconds 00000100:00100000:1.0:1788832995.537986:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831040 00000100:00100000:1.0:1788832995.537992:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831040 00000100:00100000:1.0:1788832995.538056:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832995.538064:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:3278:x1875727265831040:12345-0@lo:103: 00010000:00010000:1.0:1788832995.538074:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832995.538087:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe7b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe7b0 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.538109:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832995.538147:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:3278:x1875727265831040:12345-0@lo:103: Request processed in 84us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832995.538153:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832995.538466:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265831040:0@lo:103: 00000100:00100000:3.0:1788832995.538749:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831168 00000100:00100000:3.0:1788832995.538754:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831168 00000100:00100000:3.0:1788832995.538789:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788832995.538796:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+10:6651:x1875727265831168:12345-0@lo:101: 00010000:00010000:3.0:1788832995.538805:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832995.538818:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe7cc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.538837:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.538847:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.539191:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd200, rc 0) 00000100:00100000:3.0:1788832995.539248:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831168:12345-0@lo:101: Request processed in 452us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.539254:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832995.539786:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831168:0@lo:101: 00010000:00010000:0.0:1788832995.539803:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.539814:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832995.540006:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831296:0@lo:501: 00000100:00100000:0.0:1788832995.540209:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832995.540278:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538900 going to sleep for 11 seconds 00000100:00100000:2.0:1788832995.545907:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831296 00000100:00100000:2.0:1788832995.545923:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831296 00000100:00100000:1.0:1788832995.546133:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788832995.546144:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831296:12345-0@lo:501: 00000100:00100000:1.0:1788832995.546487:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831296:12345-0@lo:501: Request processed in 345us (6278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832995.546495:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832995.546913:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831296:0@lo:501: 00000100:00100000:0.0:1788832995.546955:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831424:0@lo:503: 00000100:00100000:0.0:1788832995.546996:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832995.547069:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538900 going to sleep for 11 seconds 00000100:00100000:3.0:1788832995.547129:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831424 00000100:00100000:3.0:1788832995.547134:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831424 00000100:00100000:3.0:1788832995.547159:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788832995.547179:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831424:12345-0@lo:503: 00000100:00100000:3.0:1788832995.547345:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831424:12345-0@lo:503: Request processed in 179us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.547352:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832995.547529:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831424:0@lo:503: 00000040:00080000:0.0:1788832995.547807:0:6651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788832995.547898:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831552:0@lo:502: 00000100:00100000:0.0:1788832995.547937:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832995.547967:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538900 going to sleep for 11 seconds 00000100:00100000:1.0:1788832995.548059:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831552 00000100:00100000:1.0:1788832995.548065:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831552 00000100:00100000:1.0:1788832995.548102:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788832995.548110:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831552:12345-0@lo:502: 00000100:00100000:1.0:1788832995.548265:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831552:12345-0@lo:502: Request processed in 155us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832995.548273:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832995.549398:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831552:0@lo:502: 00000040:00080000:0.0:1788832995.550025:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788832995.550131:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788832995.550163:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788832995.550209:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788832995.550244:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788832995.550542:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788832995.550589:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831680:0@lo:502: 00000100:00100000:0.0:1788832995.550968:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832995.551097:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538900 going to sleep for 11 seconds 00000100:00100000:2.0:1788832995.554490:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831680 00000100:00100000:2.0:1788832995.554506:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831680 00000100:00100000:3.0:1788832995.554753:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832995.554764:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831680:12345-0@lo:502: 00000100:00100000:3.0:1788832995.555015:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831680:12345-0@lo:502: Request processed in 252us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.555023:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832995.555067:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831680:0@lo:502: 00000040:00080000:0.0:1788832995.555227:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788832995.555242:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788832995.557383:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788832995.557395:0:6670:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788832995.557402:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832995.557405:0:6670:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788832995.557410:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832995.557452:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cea3f714d28) 00000020:00000080:0.0:1788832995.557473:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788832995.557481:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788832995.557583:0:6670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea1fc5c800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788832995.557591:0:6670:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788832995.557597:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c08e876ed3fe7e1 00010000:00010000:0.0:1788832995.565329:0:6670:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788832995.565631:0:6670:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788832995.575188:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788832995.575490:0:6670:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788832995.597234:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788832995.598648:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788832995.600743:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788832995.600755:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832995.600762:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832995.600763:0:6670:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788832995.600767:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832995.600771:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832995.600773:0:6670:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788832995.600782:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788832995.600784:0:6670:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788832995.600832:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832995.600835:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832995.600836:0:6670:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788832995.600839:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788832995.601152:0:6651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788832995.601185:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788832995.601238:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.601251:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832995.601258:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea1fc5c800 from 1 10000000:01000000:1.0:1788832995.601261:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832995.601446:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.601456:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.601466:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832995.601488:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831808:0@lo:101: 00000100:00100000:1.0:1788832995.601550:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.601628:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832995.601746:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831808 00000100:00100000:0.0:1788832995.601753:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831808 00000100:00100000:0.0:1788832995.601833:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832995.601842:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:6651:x1875727265831808:12345-0@lo:101: 00010000:00010000:0.0:1788832995.601856:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832995.601879:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe7e8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.601901:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.601911:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.601920:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477400, rc 0) 00000100:00100000:0.0:1788832995.602205:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265831808:12345-0@lo:101: Request processed in 363us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832995.602212:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788832995.602487:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831808:0@lo:101: 00010000:00010000:2.0:1788832995.602504:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832995.602513:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832995.602607:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831936:0@lo:501: 00000100:00100000:2.0:1788832995.602638:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832995.602718:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07d3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788832995.606721:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265831936 00000100:00100000:0.0:1788832995.606735:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265831936 00000100:00100000:3.0:1788832995.606887:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788832995.606898:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265831936:12345-0@lo:501: 00000100:00100000:3.0:1788832995.607214:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265831936:12345-0@lo:501: Request processed in 317us (4574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.607221:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788832995.607784:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265831936:0@lo:501: 00000100:00100000:2.0:1788832995.607828:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832064:0@lo:503: 00000100:00100000:2.0:1788832995.607871:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832995.607908:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07d3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788832995.608173:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832064 00000100:00100000:0.0:1788832995.608179:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832064 00000100:00100000:0.0:1788832995.608220:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832995.608228:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265832064:12345-0@lo:503: 00000100:00100000:0.0:1788832995.608550:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265832064:12345-0@lo:503: Request processed in 322us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832995.608557:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788832995.610086:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832064:0@lo:503: 00000040:00080000:2.0:1788832995.610518:0:6651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832995.610597:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832192:0@lo:502: 00000100:00100000:2.0:1788832995.610951:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832995.610986:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07d3b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832995.614820:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832192 00000100:00100000:1.0:1788832995.614834:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832192 00000100:00100000:1.0:1788832995.614900:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788832995.614911:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265832192:12345-0@lo:502: 00000100:00100000:1.0:1788832995.615203:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265832192:12345-0@lo:502: Request processed in 294us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832995.615210:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788832995.615261:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832192:0@lo:502: 00000040:00080000:1.0:1788832995.615905:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788832995.615958:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788832995.615992:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832320:0@lo:502: 00000100:00100000:1.0:1788832995.620257:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.620502:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832995.622811:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832320 00000100:00100000:0.0:1788832995.622827:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832320 00000100:00100000:0.0:1788832995.623934:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788832995.623948:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265832320:12345-0@lo:502: 00000100:00100000:2.0:1788832995.624603:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265832320:12345-0@lo:502: Request processed in 657us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.624613:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788832995.624746:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832320:0@lo:502: 00000040:00080000:1.0:1788832995.624949:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788832995.624965:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788832995.625961:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832995.625973:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832995.625975:0:6674:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788832995.625982:0:6674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea1fc5c800 00000020:00000080:3.0:1788832995.625996:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788832995.626023:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832995.626026:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832995.626027:0:6674:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788832995.626162:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788832995.626439:0:6651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788832995.626463:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788832995.626518:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.626531:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832995.626572:0:6651:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788832995.626575:0:6651:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cea1fc5c800 10000000:01000000:1.0:1788832995.626577:0:6651:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cea1fc5c800 10000000:01000000:1.0:1788832995.626581:0:6651:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788832995.626586:0:6651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea1fc5c800 from 1 10000000:01000000:1.0:1788832995.626588:0:6651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832995.626618:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.626626:0:6651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.626634:0:6651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832995.626652:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832448:0@lo:101: 00000100:00100000:1.0:1788832995.626718:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.626757:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832995.626810:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832448 00000100:00100000:3.0:1788832995.626816:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832448 00000100:00100000:3.0:1788832995.626860:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788832995.626964:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265832448:12345-0@lo:101: 00010000:00010000:3.0:1788832995.626975:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832995.626987:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe7f6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.627009:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.627018:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.627026:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dca00, rc 0) 00000100:00100000:3.0:1788832995.627087:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832448:12345-0@lo:101: Request processed in 126us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832995.627146:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832448:0@lo:101: 00010000:00010000:1.0:1788832995.627159:0:6651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.627182:0:6651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832995.627279:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832576:0@lo:501: 00000100:00100000:1.0:1788832995.627307:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.627333:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832995.627585:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832576 00000100:00100000:2.0:1788832995.627591:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832576 00000100:00100000:3.0:1788832995.627791:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788832995.627942:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832995.627952:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832576:12345-0@lo:501: 00000100:00100000:2.0:1788832995.628213:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832576:12345-0@lo:501: Request processed in 263us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.628221:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788832995.628302:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832576:0@lo:501: 00000100:00100000:1.0:1788832995.628336:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832704:0@lo:503: 00000100:00100000:1.0:1788832995.628388:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.628705:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832995.628829:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832704 00000100:00100000:0.0:1788832995.628835:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832704 00000100:00100000:0.0:1788832995.628871:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788832995.628879:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832704:12345-0@lo:503: 00000100:00100000:0.0:1788832995.629066:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832704:12345-0@lo:503: Request processed in 187us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832995.629073:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788832995.629193:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832704:0@lo:503: 00000040:00080000:1.0:1788832995.629595:0:6651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832995.629657:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832832:0@lo:502: 00000100:00100000:1.0:1788832995.629755:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.629788:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832995.629858:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832832 00000100:00100000:2.0:1788832995.629872:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832832 00000100:00100000:2.0:1788832995.629900:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832995.629907:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832832:12345-0@lo:502: 00000100:00100000:2.0:1788832995.630107:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832832:12345-0@lo:502: Request processed in 200us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832995.630114:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832995.630263:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832832:0@lo:502: 00000040:00080000:1.0:1788832995.630674:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788832995.631249:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788832995.631417:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788832995.631477:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788832995.631506:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788832995.631542:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788832995.631570:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788832995.631614:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788832995.631653:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788832995.631684:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788832995.632155:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788832995.632199:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788832995.632227:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788832995.632252:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788832995.632585:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788832995.632621:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788832995.632647:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788832995.632684:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788832995.632791:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788832995.632819:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788832995.632856:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788832995.632981:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788832995.633009:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788832995.634023:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788832995.634509:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788832995.634548:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788832995.634604:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788832995.634640:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788832995.634690:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832960:0@lo:502: 00000100:00100000:2.0:1788832995.634767:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832995.634855:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07d3ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832995.635196:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265832960 00000100:00100000:0.0:1788832995.635203:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265832960 00000100:00100000:0.0:1788832995.635288:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788832995.635298:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832960:12345-0@lo:502: 00000100:00100000:0.0:1788832995.635688:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265832960:12345-0@lo:502: Request processed in 390us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832995.635706:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788832995.635786:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265832960:0@lo:502: 00000040:00080000:3.0:1788832995.635889:0:6651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788832995.635901:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788832995.636634:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788832995.636648:0:6675:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cea06993370) 00000020:00000080:3.0:1788832995.636666:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788832995.636742:0:6675:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea1fc5c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788832995.636755:0:6675:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea1fc5c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788832995.636758:0:6675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea1fc5c800 3 00010000:00080000:3.0:1788832995.636795:0:6675:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea3f68f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.155@tcp at head 00010000:00010000:3.0:1788832995.641402:0:6675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788832995.643533:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788832995.643571:0:6675:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832995.643589:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8c08e876ed3fe80b 00000100:00080000:3.0:1788832995.643599:0:6675:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832995.643605:0:6675:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cea3f68f000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1788832995.643637:0:6675:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea06749880 x1875727265833088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832995.644120:0:6675:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788832995.645288:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875727265833088:0@lo:38: 00000100:00100000:1.0:1788832995.645366:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832995.645627:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833088 00000100:00100000:3.0:1788832995.645637:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833088 00000100:00100000:3.0:1788832995.645687:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832995.645694:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3275:x1875727265833088:12345-0@lo:38: 00010000:00080000:3.0:1788832995.645719:0:5813:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:3.0:1788832995.645751:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8c08e876ed3fe812 00000004:00100000:3.0:1788832995.645766:0:5813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788832995.645800:0:5813:0:(import.c:65:import_set_state_nolock()) ffff9cea3b3ba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832995.645852:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875727265833088:12345-0@lo:38: Request processed in 158us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832995.645860:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788832995.645989:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cea06749880 x1875727265833088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832995.646000:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832995.646008:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788832995.646015:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788832995.646019:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788832995.646021:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea3f68f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788832995.646026:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875727265833088:0@lo:38: 00000040:00080000:3.0:1788832995.647771:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788832995.650129:0:6651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788832995.650171:0:6651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832995.650195:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.650207:0:6651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788832995.650263:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788832995.650265:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832995.650267:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832995.650268:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832995.650269:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832995.650270:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832995.650272:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832995.650273:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832995.650275:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832995.650276:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832995.650277:0:6651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832995.650282:0:6651:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788832995.650284:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832995.650286:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832995.650287:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832995.650288:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832995.650289:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832995.650290:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832995.650291:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832995.650292:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832995.650293:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832995.650294:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832995.650295:0:6651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832995.650321:0:6651:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788832995.650338:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265833216:0@lo:253: 00000100:00100000:1.0:1788832995.650400:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.650459:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833216 00000100:00100000:1.0:1788832995.650466:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833216 00000100:00100000:1.0:1788832995.650506:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788832995.650513:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:6651:x1875727265833216:12345-0@lo:253: 20000000:01000000:1.0:1788832995.650538:0:5804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788832995.650550:0:5804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788832995.652011:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fc000 going to sleep for 11 seconds 20000000:01000000:0.0:1788832995.701060:0:5804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788832995.701075:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788832995.701124:0:5828:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788832995.701129:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788832995.701148:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.701186:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe77f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.701195:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.701230:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.701242:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe77f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 13 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.701255:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1875727265833344:0@lo:104: 00000100:00100000:3.0:1788832995.701326:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832995.701388:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788832995.701516:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833344 00000100:00100000:0.0:1788832995.701524:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833344 00000100:00100000:0.0:1788832995.701579:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832995.701589:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5828:x1875727265833344:12345-0@lo:104: 00010000:00010000:0.0:1788832995.701619:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832995.701669:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788832995.701675:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5828:x1875727265833344:12345-0@lo:104: Request processed in 88us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832995.701682:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788832995.701809:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832995.701821:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.701828:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477200 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:1.0:1788832995.701832:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.701840:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832995.701846:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832995.701852:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832995.701887:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.701894:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832995.701912:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.701919:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe77f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.701934:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832995.701936:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832995.701938:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832995.701951:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265833472:0@lo:103: 00000100:00100000:1.0:1788832995.701983:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832995.702018:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833472 00000100:00100000:1.0:1788832995.702022:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833472 00010000:00010000:1.0:1788832995.702083:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe77f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 14 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832995.702104:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832995.702110:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3279:x1875727265833472:12345-0@lo:103: 00010000:00010000:1.0:1788832995.702120:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832995.702125:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe77f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 14 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702135:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe77f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 14 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702151:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702159:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832995.702179:0:5799:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001981656s 00010000:00010000:1.0:1788832995.702183:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702189:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702200:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702206:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702212:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dde00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788832995.702222:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702230:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702239:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832995.702248:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832995.702278:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3279:x1875727265833472:12345-0@lo:103: Request processed in 168us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832995.702284:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832995.702422:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265833472:0@lo:103: 00010000:00010000:3.0:1788832995.702594:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe77f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe778 expref: 13 pid: 5806 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832995.702682:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1875727265833344:0@lo:104: 00010000:00010000:3.0:1788832995.702696:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.702703:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.702709:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832995.702715:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe819 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832995.712842:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:6651:x1875727265833216:12345-0@lo:253: Request processed in 62321us (62434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832995.712855:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788832995.712946:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:6651:1875727265833216:0@lo:253: 10000000:01000000:3.0:1788832995.712961:0:6651:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788832995.712964:0:6651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788832995.712965:0:6651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832995.712966:0:6651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832995.712968:0:6651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832995.712969:0:6651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832995.712970:0:6651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832995.712972:0:6651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832995.712973:0:6651:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832995.712974:0:6651:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832995.712976:0:6651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832995.712977:0:6651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788832995.712992:0:6651:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788832995.722885:0:6651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788832995.723094:0:6651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788832995.723719:0:6651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788832995.723888:0:6651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788832995.724697:0:6651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788832995.725000:0:6651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788832995.726938:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788832995.972184:0:6651:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788832995.972191:0:6651:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788832995.972243:0:6651:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788832995.972304:0:6651:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788832995.972322:0:6651:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788832995.972352:0:6651:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788832996.335150:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832997.358698:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832998.391231:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832999.407329:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833000.430426:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833001.071777:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265833600:0@lo:400: 00000100:00100000:1.0:1788833001.071843:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833001.071890:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833001.071896:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265833728:0@lo:400: 00000100:00100000:1.0:1788833001.071922:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833001.071951:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265833856:0@lo:400: 00000100:00100000:1.0:1788833001.071972:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833001.072003:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833600 00000100:00100000:1.0:1788833001.072010:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833600 00000100:00100000:1.0:1788833001.072072:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788833001.072082:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3276:x1875727265833600:12345-0@lo:400: 00000100:00100000:1.0:1788833001.072127:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3276:x1875727265833600:12345-0@lo:400: Request processed in 47us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833001.072143:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788833001.072174:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833728 00000100:00100000:1.0:1788833001.072178:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833728 00000100:00100000:1.0:1788833001.072201:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833856 00000100:00100000:1.0:1788833001.072203:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833856 00000100:00100000:1.0:1788833001.072232:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833001.072239:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265833728:12345-0@lo:400: 00000100:00100000:1.0:1788833001.072271:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265833728:12345-0@lo:400: Request processed in 34us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833001.072277:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833001.072288:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788833001.072293:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265833856:12345-0@lo:400: 00000100:00080000:0.0:1788833001.072564:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788833001.072666:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea269c8700 x1875727265833728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833001.072680:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265833728:0@lo:400: 00000100:00100000:0.0:1788833001.072691:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265833600:0@lo:400: 00000100:00100000:1.0:1788833001.072809:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265833856:12345-0@lo:400: Request processed in 516us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833001.072822:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788833001.072893:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea269c8380 x1875727265833856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833001.072903:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265833856:0@lo:400: 00010000:00010000:0.0:1788833001.460216:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788833002.413089:0:7019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788833002.477245:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833003.504538:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833004.527972:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788833005.165142:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788833005.165151:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea100dd800 from 21 10000000:01000000:0.0:1788833005.165173:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788833005.165234:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.165246:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.165257:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833005.165281:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265833984:0@lo:101: 00000100:00100000:0.0:1788833005.165367:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.165664:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.165806:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265833984 00000100:00100000:1.0:1788833005.165815:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265833984 00000100:00100000:1.0:1788833005.165873:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788833005.165884:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265833984:12345-0@lo:101: 00010000:00010000:1.0:1788833005.165897:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833005.165910:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe820 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.165934:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.165945:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.165968:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea42167200, rc 0) 00000100:00100000:1.0:1788833005.166021:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265833984:12345-0@lo:101: Request processed in 138us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.166028:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788833005.166146:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265833984:0@lo:101: 00010000:00010000:2.0:1788833005.166162:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833005.166172:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833005.166245:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834112:0@lo:501: 00000100:00100000:2.0:1788833005.166276:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833005.166308:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea113959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.166581:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265834112 00000100:00100000:1.0:1788833005.166586:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265834112 00000100:00100000:1.0:1788833005.166617:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788833005.166625:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265834112:12345-0@lo:501: 00000100:00100000:1.0:1788833005.166944:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265834112:12345-0@lo:501: Request processed in 319us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.166951:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788833005.167122:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834112:0@lo:501: 00000100:00100000:3.0:1788833005.167155:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834240:0@lo:503: 00000100:00100000:3.0:1788833005.167196:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833005.167310:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abe180 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.167480:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265834240 00000100:00100000:1.0:1788833005.167484:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265834240 00000100:00100000:1.0:1788833005.167513:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788833005.167519:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265834240:12345-0@lo:503: 00000100:00100000:1.0:1788833005.167775:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265834240:12345-0@lo:503: Request processed in 255us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.167782:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788833005.168075:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834240:0@lo:503: 00000100:00100000:3.0:1788833005.177693:0:7123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7123:1875727265834368:0@lo:502: 00000100:00100000:3.0:1788833005.177780:0:7123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833005.177848:0:7123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.177918:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265834368 00000100:00100000:1.0:1788833005.177925:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265834368 00000100:00100000:1.0:1788833005.177967:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788833005.177975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7123:x1875727265834368:12345-0@lo:502: 00000100:00100000:1.0:1788833005.178301:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7123:x1875727265834368:12345-0@lo:502: Request processed in 326us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.178309:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788833005.178587:0:7123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7123:1875727265834368:0@lo:502: 00000100:00100000:3.0:1788833005.178650:0:7123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7123:1875727265834496:0@lo:502: 00000100:00100000:3.0:1788833005.178685:0:7123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833005.178719:0:7123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833005.178783:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265834496 00000100:00100000:0.0:1788833005.178788:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265834496 00000100:00100000:0.0:1788833005.178823:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788833005.178831:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7123:x1875727265834496:12345-0@lo:502: 00000100:00100000:0.0:1788833005.178991:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7123:x1875727265834496:12345-0@lo:502: Request processed in 161us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833005.178998:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788833005.179339:0:7123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7123:1875727265834496:0@lo:502: 00000040:00080000:3.0:1788833005.179386:0:7123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788833005.179619:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788833005.179640:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788833005.179650:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.179661:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833005.179670:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788833005.179672:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea100dd800 from 4 10000000:01000000:0.0:1788833005.179683:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788833005.179710:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.179719:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.179728:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833005.179742:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834624:0@lo:101: 00000100:00100000:0.0:1788833005.179777:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.179813:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152540 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.179888:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265834624 00000100:00100000:1.0:1788833005.179899:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265834624 00000100:00100000:1.0:1788833005.179922:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788833005.179929:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265834624:12345-0@lo:101: 00010000:00010000:1.0:1788833005.179939:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833005.179952:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe82e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.179972:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.179982:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.179990:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea42166c00, rc 0) 00000100:00100000:1.0:1788833005.180062:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265834624:12345-0@lo:101: Request processed in 133us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.180068:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788833005.180237:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834624:0@lo:101: 00010000:00010000:0.0:1788833005.180248:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.180257:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833005.180304:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834752:0@lo:256: 00000100:00100000:0.0:1788833005.180334:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.180364:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152540 going to sleep for 11 seconds 00000100:00100000:2.0:1788833005.180576:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265834752 00000100:00100000:2.0:1788833005.180581:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265834752 00000100:00100000:2.0:1788833005.180601:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788833005.180607:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265834752:12345-0@lo:256: 20000000:01000000:2.0:1788833005.180621:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788833005.180636:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788833005.180639:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788833005.180722:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265834752:12345-0@lo:256: Request processed in 114us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.180729:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788833005.180793:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834752:0@lo:256: 10000000:01000000:0.0:1788833005.180832:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788833005.180839:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.180847:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833005.180861:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788833005.180863:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788833005.180865:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788833005.180881:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.180889:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.180897:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833005.180909:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834880:0@lo:101: 00000100:00100000:0.0:1788833005.180935:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.180960:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152540 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.181017:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265834880 00000100:00100000:1.0:1788833005.181021:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265834880 00000100:00100000:1.0:1788833005.181076:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788833005.181083:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265834880:12345-0@lo:101: 00010000:00010000:1.0:1788833005.181092:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833005.181104:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe83c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.181120:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.181131:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.181149:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea42167e00, rc 0) 00000100:00100000:1.0:1788833005.181184:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265834880:12345-0@lo:101: Request processed in 101us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.181190:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788833005.181762:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265834880:0@lo:101: 00010000:00010000:0.0:1788833005.181777:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.181786:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833005.181835:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265835008:0@lo:501: 00000100:00100000:0.0:1788833005.181867:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.181902:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152540 going to sleep for 11 seconds 00000100:00100000:2.0:1788833005.181958:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835008 00000100:00100000:2.0:1788833005.181963:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835008 00000100:00100000:2.0:1788833005.181997:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788833005.182003:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265835008:12345-0@lo:501: 00000100:00100000:2.0:1788833005.182494:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265835008:12345-0@lo:501: Request processed in 490us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.182501:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788833005.182675:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265835008:0@lo:501: 00000100:00100000:0.0:1788833005.182707:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265835136:0@lo:503: 00000100:00100000:0.0:1788833005.182753:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.182783:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152540 going to sleep for 11 seconds 00000100:00100000:2.0:1788833005.182833:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835136 00000100:00100000:2.0:1788833005.182838:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835136 00000100:00100000:2.0:1788833005.184008:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788833005.184024:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265835136:12345-0@lo:503: 00000100:00100000:2.0:1788833005.184386:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265835136:12345-0@lo:503: Request processed in 357us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.184394:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788833005.184508:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265835136:0@lo:503: 00000100:00100000:0.0:1788833005.194606:0:7124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7124:1875727265835264:0@lo:502: 00000100:00100000:0.0:1788833005.194691:0:7124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.203150:0:7124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152480 going to sleep for 11 seconds 00000100:00100000:3.0:1788833005.209545:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835264 00000100:00100000:3.0:1788833005.209561:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835264 00000100:00100000:1.0:1788833005.210525:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788833005.210544:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7124:x1875727265835264:12345-0@lo:502: 00000100:00100000:1.0:1788833005.210889:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7124:x1875727265835264:12345-0@lo:502: Request processed in 352us (16196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.210897:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788833005.211090:0:7124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7124:1875727265835264:0@lo:502: 00000020:01000000:0.0:1788833005.211130:0:7124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788833005.211138:0:7124:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788833005.211145:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833005.211147:0:7124:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788833005.211152:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788833005.211156:0:7124:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:0.0:1788833005.211179:0:7124:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788833005.211182:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788833005.211196:0:7124:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cea3f7119b8) 00000020:00000080:0.0:1788833005.211216:0:7124:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788833005.211221:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788833005.211297:0:7124:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788833005.211302:0:7124:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788833005.211308:0:7124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3fe851 00010000:00080000:0.0:1788833005.211336:0:7124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea26c6b000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:0.0:1788833005.211588:0:7124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788833005.307653:0:7124:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788833005.307686:0:7124:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788833005.308804:0:7124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788833005.313372:0:7124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788833005.313443:0:7124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788833005.313502:0:7124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788833005.314129:0:7127:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833005.314135:0:7127:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788833005.315343:0:7124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788833005.315356:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788833005.315401:0:7124:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788833005.315422:0:7124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3fe858 00000100:00080000:2.0:1788833005.315433:0:7124:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788833005.315438:0:7124:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cea26c6b000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833005.315470:0:7124:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea05cab100 x1875727265835392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788833005.315531:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265835392:0@lo:8: 00000100:00100000:1.0:1788833005.315615:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833005.315739:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835392 00000100:00100000:3.0:1788833005.315746:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835392 00000100:00100000:3.0:1788833005.315788:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788833005.315796:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875727265835392:12345-0@lo:8: 00010000:00080000:3.0:1788833005.315819:0:6654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:3.0:1788833005.315843:0:6654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3fe85f 00002000:00100000:3.0:1788833005.315869:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cea3f688000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788833005.315874:0:6654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788833005.315877:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788833005.315997:0:6654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788833005.316170:0:6654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788833005.316194:0:6654:0:(import.c:65:import_set_state_nolock()) ffff9cea3f68a000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788833005.316335:0:7124:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788833005.316439:0:7124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833005.316444:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833005.316446:0:7124:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788833005.316450:0:7124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833005.316453:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833005.316454:0:7124:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788833005.316457:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788833005.316459:0:7124:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788833005.316488:0:7124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7124:1875727265835520:0@lo:502: 00000100:00100000:2.0:1788833005.316546:0:7124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833005.316588:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835520 00000100:00100000:2.0:1788833005.316593:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835520 00000100:00100000:2.0:1788833005.316624:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788833005.316631:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7124:x1875727265835520:12345-0@lo:502: 00000100:00100000:2.0:1788833005.316862:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7124:x1875727265835520:12345-0@lo:502: Request processed in 231us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.316869:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788833005.316919:0:7124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f479480 going to sleep for 11 seconds 00000100:00100000:2.0:1788833005.316939:0:7124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7124:1875727265835520:0@lo:502: 00000020:01000000:2.0:1788833005.316972:0:7124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833005.316976:0:7124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833005.316977:0:7124:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788833005.316980:0:7124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1788833005.318667:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833005.318687:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265835648:0@lo:400: 00000100:00100000:2.0:1788833005.318749:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833005.318793:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265835776:0@lo:400: 00000100:00100000:2.0:1788833005.318821:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833005.318854:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835648 00000100:00100000:2.0:1788833005.318861:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835648 00000100:00100000:2.0:1788833005.318914:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835776 00000100:00100000:2.0:1788833005.318918:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835776 00000100:00100000:2.0:1788833005.318948:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833005.318956:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265835648:12345-0@lo:400: 00000100:00100000:2.0:1788833005.319181:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265835648:12345-0@lo:400: Request processed in 47us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.319189:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833005.319209:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833005.319233:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265835776:12345-0@lo:400: 00000100:00100000:2.0:1788833005.319269:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265835776:12345-0@lo:400: Request processed in 37us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.319274:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788833005.319302:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788833005.319329:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05ca8000 x1875727265835776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833005.319343:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265835776:0@lo:400: 00010000:00080000:2.0:1788833005.319372:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05ca8e00 x1875727265835648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833005.319391:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265835648:0@lo:400: 00000020:01000000:0.0:1788833005.320343:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788833005.320391:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788833005.320415:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.320428:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833005.320439:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788833005.320442:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cea10ad4d28 from 1 10000000:01000000:0.0:1788833005.320445:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788833005.320482:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.320490:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833005.320499:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833005.320521:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265835904:0@lo:101: 00000100:00100000:0.0:1788833005.320577:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.320613:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152900 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.322055:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265835904 00000100:00100000:1.0:1788833005.322068:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265835904 00000100:00100000:1.0:1788833005.322137:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788833005.322148:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265835904:12345-0@lo:101: 00010000:00010000:1.0:1788833005.322166:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833005.322188:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe866 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.322214:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.322225:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.322250:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea42166200, rc 0) 00000100:00100000:1.0:1788833005.322317:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265835904:12345-0@lo:101: Request processed in 172us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833005.322323:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788833005.322372:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265835904:0@lo:101: 00010000:00010000:1.0:1788833005.322398:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.322407:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833005.322468:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265836032:0@lo:501: 00000100:00100000:1.0:1788833005.322498:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833005.322523:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088ef780 going to sleep for 11 seconds 00000100:00100000:1.0:1788833005.322535:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836032 00000100:00100000:1.0:1788833005.322537:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836032 00000100:00100000:1.0:1788833005.322552:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788833005.322558:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265836032:12345-0@lo:501: 00000100:00100000:1.0:1788833005.322788:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265836032:12345-0@lo:501: Request processed in 228us (288us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788833005.322795:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788833005.322823:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265836032:0@lo:501: 10000000:01000000:1.0:1788833005.322845:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788833005.322851:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833005.322871:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833005.326339:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1875727265835392:12345-0@lo:8: Request processed in 10534us (10715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833005.326351:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788833005.326452:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05cab100 x1875727265835392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788833015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833005.326463:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788833005.326474:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788833005.326483:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788833005.326488:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788833005.326491:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea26c6b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788833005.326517:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788833005.326523:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265835392:0@lo:8: 00000004:00080000:3.0:1788833005.327389:0:7127:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788833005.327486:0:7127:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 139393454217ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788833005.379704:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833005.379734:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265836160:0@lo:13: 00000100:00100000:2.0:1788833005.379827:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788833005.379890:0:7128:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788833005.379914:0:7128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836288:0@lo:7: 00000100:00100000:2.0:1788833005.380134:0:7128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833005.380159:0:7128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f479900 going to sleep for 11 seconds 00000100:00100000:0.0:1788833005.380366:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836160 00000100:00100000:0.0:1788833005.380373:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836160 00000100:00100000:0.0:1788833005.380448:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788833005.380458:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875727265836160:12345-0@lo:13: 00002000:00000024:0.0:1788833005.380494:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788833005.380549:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875727265836160:12345-0@lo:13: Request processed in 92us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833005.380556:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788833005.380605:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05ca8e00 x1875727265836160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833005.380642:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265836160:0@lo:13: 00000004:00080000:1.0:1788833005.380746:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:2.0:1788833005.380863:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788833005.381215:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836288 00000100:00100000:2.0:1788833005.381296:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836288 00000100:00100000:2.0:1788833005.381338:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833005.381346:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7128:x1875727265836288:12345-0@lo:7: 00002000:00080000:2.0:1788833005.388903:0:6656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788833005.388912:0:6656:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788833005.389023:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7128:x1875727265836288:12345-0@lo:7: Request processed in 7673us (8884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.389068:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788833005.389687:0:7128:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05cabb80 x1875727265836288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788833021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833005.389710:0:7128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836288:0@lo:7: 00000004:00080000:3.0:1788833005.389726:0:7128:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788833005.389770:0:7128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836416:0@lo:5: 00000100:00100000:3.0:1788833005.389818:0:7128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833005.389867:0:7128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833005.389923:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836416 00000100:00100000:0.0:1788833005.389930:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836416 00000100:00100000:0.0:1788833005.389990:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833005.389999:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7128:x1875727265836416:12345-0@lo:5: 00002000:00080000:0.0:1788833005.390022:0:6654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788833005.390026:0:6654:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788833005.390669:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:7128:x1875727265836416:12345-0@lo:5: Request processed in 670us (849us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788833005.390678:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788833005.390764:0:7128:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea06749180 x1875727265836416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788833021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833005.390779:0:7128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836416:0@lo:5: 00000004:00080000:3.0:1788833005.390790:0:7128:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788833005.390817:0:7128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836544:0@lo:700: 00000100:00100000:3.0:1788833005.390845:0:7128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833005.390871:0:7128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833005.391393:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836544 00000100:00100000:0.0:1788833005.391400:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836544 00000100:00100000:0.0:1788833005.391438:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788833005.391446:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7128:x1875727265836544:12345-0@lo:700: 00000100:00100000:0.0:1788833005.391478:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6662:1875727265836672:0@lo:700: 00000100:00100000:0.0:1788833005.391508:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833005.391533:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea20152240 going to sleep for 11 seconds 00000100:00100000:2.0:1788833005.391625:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836672 00000100:00100000:2.0:1788833005.391629:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836672 00000100:00100000:2.0:1788833005.391658:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833005.391665:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6662:x1875727265836672:12345-0@lo:700: 40000000:02000000:0.0:1788833005.448657:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788833005.462423:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6662:x1875727265836672:12345-0@lo:700: Request processed in 70749us (70905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833005.462444:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788833005.466799:0:6662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40d82a00 x1875727265836672/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788833021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833005.466820:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6662:1875727265836672:0@lo:700: 40000000:02000000:3.0:1788833005.466832:0:6662:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:2.0:1788833005.554251:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833005.628022:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788833005.628274:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788833005.630282:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7128:x1875727265836544:12345-0@lo:700: Request processed in 238827us (239426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833005.630299:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788833005.630396:0:7128:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea06748e00 x1875727265836544/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788833021 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833005.630410:0:7128:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788833005.630431:0:7128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836544:0@lo:700: 00000004:02000040:3.0:1788833005.693534:0:7128:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788833005.699433:0:7128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836800:0@lo:5: 00000100:00100000:3.0:1788833005.699501:0:7128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833005.699554:0:7128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abe000 going to sleep for 11 seconds 00000100:00100000:0.0:1788833005.699682:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836800 00000100:00100000:0.0:1788833005.699691:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836800 00000100:00100000:0.0:1788833005.699738:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833005.699755:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7128:x1875727265836800:12345-0@lo:5: 00002000:00080000:1.0:1788833005.708970:0:6655:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788833005.708990:0:6655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788833005.715645:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7128:x1875727265836800:12345-0@lo:5: Request processed in 15883us (16135us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788833005.715661:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788833005.718558:0:7128:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea06748e00 x1875727265836800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788833021 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833005.718580:0:7128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7128:1875727265836800:0@lo:5: 00000004:00080000:3.0:1788833005.718597:0:7128:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788833006.574269:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833007.598497:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833007.609760:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788833008.621291:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833009.645575:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833010.669842:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833010.797327:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265836928:0@lo:13: 00000100:00100000:0.0:1788833010.797408:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833010.797527:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265836928 00000100:00100000:3.0:1788833010.797535:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265836928 00000100:00100000:3.0:1788833010.797593:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788833010.797603:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265836928:12345-0@lo:13: 00002000:00000024:3.0:1788833010.797635:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833010.797680:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265836928:12345-0@lo:13: Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833010.797688:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788833010.797740:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788833010.797771:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea06748700 x1875727265836928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833010.797781:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788833010.797801:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265836928:0@lo:13: 00000100:00100000:0.0:1788833010.798163:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265837184:0@lo:400: 00000100:00100000:0.0:1788833010.798193:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833010.798211:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833010.798216:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265837312:0@lo:400: 00000100:00100000:0.0:1788833010.798233:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833010.798286:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837184 00000100:00100000:2.0:1788833010.798291:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837184 00000100:00100000:2.0:1788833010.798322:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837312 00000100:00100000:2.0:1788833010.798325:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837312 00000100:00100000:2.0:1788833010.798360:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833010.798367:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265837184:12345-0@lo:400: 00000100:00100000:2.0:1788833010.798408:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265837184:12345-0@lo:400: Request processed in 42us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833010.798415:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833010.798430:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833010.798436:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265837312:12345-0@lo:400: 00000100:00100000:2.0:1788833010.798460:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265837312:12345-0@lo:400: Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833010.798465:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833010.798496:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265837056:0@lo:400: 00000100:00100000:2.0:1788833010.798529:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833010.798562:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837056 00000100:00100000:2.0:1788833010.798566:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837056 00000100:00100000:2.0:1788833010.798590:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788833010.798596:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3279:x1875727265837056:12345-0@lo:400: 00000100:00100000:2.0:1788833010.798628:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3279:x1875727265837056:12345-0@lo:400: Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833010.798634:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788833010.798659:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833010.798676:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265837056:0@lo:400: 00010000:00080000:2.0:1788833010.798700:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40d80000 x1875727265837312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833010.798710:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265837312:0@lo:400: 00010000:00080000:2.0:1788833010.798720:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40d80e00 x1875727265837184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833010.798727:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265837184:0@lo:400: 00010000:00010000:2.0:1788833011.693618:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833012.722398:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788833013.695055:0:7593:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788833013.695060:0:7593:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788833013.695416:0:7593:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cea06626000 00000020:01000004:0.0:1788833013.695433:0:7593:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788833013.695445:0:7593:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788833013.695458:0:7593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cea3f713370) 00000020:00000080:0.0:1788833013.695475:0:7593:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788833013.707798:0:7593:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788833013.708088:0:7593:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788833013.727591:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788833013.732539:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788833013.732576:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788833013.732638:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788833013.732666:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788833013.733319:0:7593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788833013.733342:0:7593:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788833013.733359:0:7593:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c08e876ed3fe87b 00000020:01000004:1.0:1788833013.733367:0:7593:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788833013.733389:0:7593:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.155@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788833013.733392:0:7593:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788833013.733398:0:7593:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788833013.733420:0:7593:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788833013.733425:0:7593:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:2.0:1788833013.744464:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788833013.754971:0:7593:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788833013.755008:0:7593:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.155@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788833013.755012:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788833013.755014:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788833013.755015:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788833013.755020:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788833013.755021:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788833013.755023:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788833013.755024:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788833013.755026:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788833013.755027:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788833013.755127:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788833013.755129:0:7593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788833013.755133:0:7593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788833013.755135:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788833013.755136:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788833013.755137:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788833013.755138:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788833013.755139:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788833013.755140:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788833013.755141:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788833013.755142:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788833013.755143:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788833013.755144:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788833013.755145:0:7593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788833013.755168:0:7593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788833013.755256:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265837440:0@lo:253: 00000100:00100000:0.0:1788833013.755326:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.755441:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788833013.755491:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837440 00000100:00100000:3.0:1788833013.755498:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837440 00000100:00100000:3.0:1788833013.755593:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788833013.755602:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:7593:x1875727265837440:12345-0@lo:253: 20000000:01000000:3.0:1788833013.755637:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788833013.755640:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788833013.755645:0:5807:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788833013.755648:0:5807:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788833013.756936:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788833013.757345:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788833013.757361:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788833013.757400:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788833013.757407:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788833013.757435:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788833013.757489:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788833013.757916:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788833013.757937:0:5807:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.155@tcp 20000000:01000000:3.0:1788833013.757939:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788833013.757975:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788833013.757983:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788833013.758141:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788833013.758151:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.155@tcp (null) (null) 00000040:00080000:3.0:1788833013.758271:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788833013.758283:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788833013.758487:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788833013.758569:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788833013.761580:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788833013.761613:0:5807:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.155@tcp 20000000:01000000:3.0:1788833013.761615:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788833013.761654:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788833013.761664:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788833013.761696:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788833013.761704:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.155@tcp (null) (null) 00000040:00080000:3.0:1788833013.761736:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788833013.761744:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788833013.761993:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788833013.762079:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788833013.762099:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788833013.762101:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788833013.762108:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788833013.762109:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788833013.762111:0:5807:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788833013.762123:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788833013.762126:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788833013.762163:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788833013.762165:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788833013.763112:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788833013.763313:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788833013.763362:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788833013.763663:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788833013.763723:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788833013.763804:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788833013.763819:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788833013.763822:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788833013.764438:0:7596:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788833013.764486:0:7596:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788833013.764533:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788833013.765446:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788833013.765495:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788833013.765530:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788833013.765545:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788833013.765548:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788833013.766304:0:7597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788833013.766369:0:7597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788833013.766426:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788833013.766672:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788833013.766712:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788833013.766869:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788833013.766882:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788833013.766884:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788833013.767489:0:7598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788833013.767706:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788833013.767746:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788833013.767886:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1788833013.767907:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788833013.767927:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.767945:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.767953:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.767959:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.767980:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.767987:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.767994:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.768098:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.768114:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 16 pid: 5806 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833013.768128:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269ca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837568:0@lo:104: 00000100:00100000:1.0:1788833013.768271:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788833013.768369:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.768377:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 16 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833013.768385:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837696:0@lo:104: 00010000:00010000:1.0:1788833013.768411:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.768418:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 16 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833013.768439:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837824:0@lo:104: 00010000:00010000:1.0:1788833013.768466:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.768473:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 16 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833013.768481:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837952:0@lo:104: 00010000:00010000:1.0:1788833013.768522:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.768531:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 16 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833013.768539:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265838080:0@lo:104: 00000100:00100000:1.0:1788833013.768556:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea26f67840 going to sleep for 11 seconds 00000100:00100000:3.0:1788833013.768668:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788833013.768686:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833013.768748:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833013.768902:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.768928:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837568 00000100:00100000:2.0:1788833013.768936:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837568 00000100:00100000:2.0:1788833013.768969:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837696 00000100:00100000:2.0:1788833013.768972:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837696 00000100:00100000:2.0:1788833013.768981:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837824 00000100:00100000:2.0:1788833013.768983:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837824 00000100:00100000:2.0:1788833013.768994:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833013.769009:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d11050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:5807:x1875727265837568:12345-0@lo:104: 00010000:00010000:2.0:1788833013.769021:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769106:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833013.769111:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d11050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:5807:x1875727265837568:12345-0@lo:104: Request processed in 105us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.769118:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833013.769168:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833013.769174:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:5807:x1875727265837696:12345-0@lo:104: 00010000:00010000:2.0:1788833013.769194:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769230:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788833013.769235:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:5807:x1875727265837696:12345-0@lo:104: Request processed in 62us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.769241:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833013.769254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788833013.769260:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5807:x1875727265837824:12345-0@lo:104: 00010000:00010000:2.0:1788833013.769267:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769293:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788833013.769298:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5807:x1875727265837824:12345-0@lo:104: Request processed in 39us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.769304:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788833013.769321:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788833013.769326:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769348:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477200 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833013.769352:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769360:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833013.769368:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833013.769373:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833013.769405:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769412:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833013.769429:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769436:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe86d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769450:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833013.769453:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769458:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477800 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833013.769460:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769475:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833013.769481:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833013.769486:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833013.769500:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769506:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833013.769512:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769518:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32477800/0x8c08e876ed3fe83c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe843 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769528:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833013.769531:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769536:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476800 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833013.769539:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769545:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833013.769552:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833013.769563:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833013.769577:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769583:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833013.769598:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769605:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe827 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.769615:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833013.769617:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833013.769619:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833013.769641:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265838208:0@lo:103: 00000100:00100000:2.0:1788833013.769671:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.769693:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833013.769700:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265838336:0@lo:103: 00000100:00100000:2.0:1788833013.769720:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.769748:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265838464:0@lo:103: 00000100:00100000:2.0:1788833013.769769:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788833013.769950:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833013.770049:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838208 00000100:00100000:2.0:1788833013.770056:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838208 00010000:00010000:2.0:1788833013.770077:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 17 pid: 5806 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.770093:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838336 00000100:00100000:2.0:1788833013.770095:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838336 00010000:00010000:2.0:1788833013.770113:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 18 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.770123:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838464 00000100:00100000:2.0:1788833013.770126:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838464 00010000:00010000:2.0:1788833013.770133:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 19 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.770143:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833013.770148:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265838208:12345-0@lo:103: 00010000:00010000:2.0:1788833013.770157:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833013.770161:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 19 pid: 5806 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770170:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 19 pid: 5806 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770250:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833013.770383:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea42166200/0x8c08e876ed3fe86d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe866 expref: 19 pid: 5806 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833013.770397:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269ca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837568:0@lo:104: 00000100:00100000:1.0:1788833013.770408:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837696:0@lo:104: 00000100:00100000:1.0:1788833013.770415:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837824:0@lo:104: 00000100:00100000:2.0:1788833013.770456:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:3278:x1875727265838208:12345-0@lo:103: Request processed in 307us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.770463:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833013.770478:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833013.770485:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3278:x1875727265838336:12345-0@lo:103: 00010000:00010000:2.0:1788833013.770492:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833013.770497:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 17 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770505:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 17 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770527:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea42167e00/0x8c08e876ed3fe843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe83c expref: 17 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770538:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833013.770561:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3278:x1875727265838336:12345-0@lo:103: Request processed in 77us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.770567:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833013.770579:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788833013.770584:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:3276:x1875727265838464:12345-0@lo:103: 00010000:00010000:2.0:1788833013.770592:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833013.770596:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 15 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770604:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 15 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770614:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea42167200/0x8c08e876ed3fe827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe820 expref: 15 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.770623:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833013.770657:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3276:x1875727265838464:12345-0@lo:103: Request processed in 72us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.770663:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788833013.770726:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265838464:0@lo:103: 00000100:00100000:3.0:1788833013.770963:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.771003:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265838208:0@lo:103: 00000100:00100000:0.0:1788833013.771018:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265838336:0@lo:103: 00000100:00100000:2.0:1788833013.771280:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265837952 00000100:00100000:2.0:1788833013.771285:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265837952 00000100:00100000:2.0:1788833013.771307:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838080 00000100:00100000:2.0:1788833013.771310:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838080 00000100:00100000:2.0:1788833013.771322:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833013.771327:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:5807:x1875727265837952:12345-0@lo:104: 00010000:00010000:2.0:1788833013.771357:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.771483:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833013.771489:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:5807:x1875727265837952:12345-0@lo:104: Request processed in 161us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.771495:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833013.771509:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833013.771515:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5807:x1875727265838080:12345-0@lo:104: 00010000:00010000:2.0:1788833013.771523:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833013.771575:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265837952:0@lo:104: 00000100:00100000:1.0:1788833013.771584:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1875727265838080:0@lo:104: 00010000:00010000:1.0:1788833013.771615:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833013.771654:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788833013.771661:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788833013.772103:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788833013.772110:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.772131:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea42166400 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:0.0:1788833013.772135:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.772143:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788833013.772150:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833013.772156:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788833013.772293:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.772301:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788833013.772322:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.772329:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea42166400/0x8c08e876ed3fe7f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7fd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.772352:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833013.772356:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.772361:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476c00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:0.0:1788833013.772365:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.772382:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788833013.772388:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833013.772394:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788833013.772448:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265838592:0@lo:103: 00000100:00100000:1.0:1788833013.772491:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788833013.772581:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788833013.772590:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5807:x1875727265838080:12345-0@lo:104: Request processed in 1074us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.772597:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833013.772632:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838592 00000100:00100000:2.0:1788833013.772636:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838592 00010000:00010000:2.0:1788833013.772654:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 14 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.772675:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833013.772681:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3277:x1875727265838592:12345-0@lo:103: 00010000:00010000:2.0:1788833013.772691:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833013.772696:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 14 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.772706:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 14 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.772726:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dca00/0x8c08e876ed3fe7fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe7f6 expref: 14 pid: 5804 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.772739:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833013.772767:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3277:x1875727265838592:12345-0@lo:103: Request processed in 87us (277us total) trans 0 rc 0/0 00010000:00010000:1.0:1788833013.772857:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833013.772884:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833013.772917:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265838592:0@lo:103: 00010000:00010000:0.0:1788833013.773059:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773066:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788833013.773085:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773091:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe7cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7d3 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773107:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833013.773109:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833013.773110:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833013.773160:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833013.773172:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265838720:0@lo:103: 00000100:00100000:1.0:1788833013.773209:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.773322:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838720 00000100:00100000:0.0:1788833013.773327:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838720 00010000:00010000:0.0:1788833013.773355:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 13 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.773383:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833013.773390:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3279:x1875727265838720:12345-0@lo:103: 00010000:00010000:0.0:1788833013.773398:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833013.773402:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 13 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773418:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 13 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773430:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dd200/0x8c08e876ed3fe7d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe7cc expref: 13 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773443:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773451:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773465:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773472:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773479:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773485:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773491:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833013.773495:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773502:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773528:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773538:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833013.773571:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3279:x1875727265838720:12345-0@lo:103: Request processed in 181us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833013.773576:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833013.773600:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265838720:0@lo:103: 00010000:00010000:0.0:1788833013.773613:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773620:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.773626:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932f200/0x8c08e876ed3fe882 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788833013.773636:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788833013.823103:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:7593:x1875727265837440:12345-0@lo:253: Request processed in 67494us (67769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833013.823118:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788833013.823251:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265837440:0@lo:253: 10000000:01000000:0.0:1788833013.823265:0:7593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788833013.823268:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788833013.823269:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788833013.823270:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788833013.823271:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788833013.823272:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788833013.823274:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788833013.823275:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788833013.823276:0:7593:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788833013.823278:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788833013.823279:0:7593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788833013.823312:0:7593:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cea06626000 from lustre-OST0001 10000000:01000000:0.0:1788833013.823344:0:7593:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788833013.823347:0:7593:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788833013.823355:0:7593:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cea10ad4d28 local copy 10000000:01000000:0.0:1788833013.823359:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788833013.823394:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.823407:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.823416:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.823433:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265838848:0@lo:101: 00000100:00100000:0.0:1788833013.823465:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.823497:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676000 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.823721:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838848 00000100:00100000:2.0:1788833013.823728:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838848 00000100:00100000:2.0:1788833013.823767:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788833013.823786:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+11:7593:x1875727265838848:12345-0@lo:101: 00010000:00010000:2.0:1788833013.823797:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833013.823811:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fe890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe889 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.823832:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fe890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe889 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.823843:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fe890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe889 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.823851:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516c00, rc 0) 00000100:00100000:2.0:1788833013.823893:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265838848:12345-0@lo:101: Request processed in 117us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.823899:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788833013.824057:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265838848:0@lo:101: 00010000:00010000:0.0:1788833013.824069:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.824079:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.824159:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265838976:0@lo:501: 00000100:00100000:0.0:1788833013.824195:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.824215:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676000 going to sleep for 11 seconds 00000100:00100000:1.0:1788833013.824314:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265838976 00000100:00100000:1.0:1788833013.824319:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265838976 00000100:00100000:1.0:1788833013.824361:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788833013.824368:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265838976:12345-0@lo:501: 00000100:00100000:1.0:1788833013.824536:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265838976:12345-0@lo:501: Request processed in 168us (339us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788833013.824543:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788833013.824618:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265838976:0@lo:501: 10000000:01000000:0.0:1788833013.824630:0:7593:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788833013.824661:0:7593:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788833013.824666:0:7593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.824674:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.824682:0:7593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.824704:0:7593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788833013.824721:0:7593:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cea06626000 10000000:01000000:0.0:1788833013.824725:0:7593:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788833013.824730:0:7593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788833013.824732:0:7593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788833013.824736:0:7593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788833013.824738:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788833013.824752:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.824760:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.824767:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.824849:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839104:0@lo:101: 00000100:00100000:0.0:1788833013.824876:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.824888:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788833013.824939:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833013.824945:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.824952:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476c00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:1.0:1788833013.824956:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.824964:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788833013.824979:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833013.824984:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788833013.825002:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.825009:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788833013.825054:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.825061:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c08e876ed3fe890 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.825073:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833013.825075:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833013.825076:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833013.825085:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265839104 00000100:00100000:1.0:1788833013.825089:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265839104 00000100:00100000:1.0:1788833013.825112:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788833013.825117:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839104:12345-0@lo:101: 00010000:00010000:1.0:1788833013.825126:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833013.825137:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe897 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.825153:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.825161:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833013.825173:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fa00, rc 0) 00000100:00100000:1.0:1788833013.825217:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265839104:12345-0@lo:101: Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833013.825223:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788833013.825354:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265839232:0@lo:103: 00000100:00100000:0.0:1788833013.825387:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.825439:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839104:0@lo:101: 00010000:00010000:0.0:1788833013.825450:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.825458:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.825533:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839360:0@lo:501: 00000100:00100000:0.0:1788833013.825558:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.825581:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.825660:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265839232 00000100:00100000:2.0:1788833013.825671:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265839232 00000100:00100000:2.0:1788833013.825711:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833013.825718:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3279:x1875727265839232:12345-0@lo:103: 00010000:00010000:2.0:1788833013.825728:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833013.825741:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fe890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe889 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.825751:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833013.825869:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3279:x1875727265839232:12345-0@lo:103: Request processed in 152us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.825876:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833013.825904:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265839232:0@lo:103: 00000100:00100000:2.0:1788833013.825921:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265839360 00000100:00100000:2.0:1788833013.825924:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265839360 00000100:00100000:2.0:1788833013.825945:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788833013.825951:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839360:12345-0@lo:501: 00000100:00100000:2.0:1788833013.826506:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839360:12345-0@lo:501: Request processed in 554us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.826514:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788833013.826589:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839360:0@lo:501: 00000100:00100000:0.0:1788833013.826618:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839488:0@lo:503: 00000100:00100000:0.0:1788833013.826660:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.826692:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833013.826735:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265839488 00000100:00100000:1.0:1788833013.826739:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265839488 00000100:00100000:1.0:1788833013.826768:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788833013.826782:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839488:12345-0@lo:503: 00000100:00100000:1.0:1788833013.826929:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839488:12345-0@lo:503: Request processed in 154us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833013.826934:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788833013.827076:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839488:0@lo:503: 00000040:00080000:0.0:1788833013.827400:0:7593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788833013.827481:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839616:0@lo:502: 00000100:00100000:0.0:1788833013.827529:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.827567:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833013.827730:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265839616 00000100:00100000:1.0:1788833013.827736:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265839616 00000100:00100000:1.0:1788833013.827762:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788833013.827769:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839616:12345-0@lo:502: 00000100:00100000:1.0:1788833013.828050:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839616:12345-0@lo:502: Request processed in 280us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833013.828057:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788833013.828136:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839616:0@lo:502: 00000040:00080000:0.0:1788833013.828409:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788833013.828459:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788833013.828495:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788833013.828543:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788833013.828583:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788833013.828629:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788833013.828656:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839744:0@lo:502: 00000100:00100000:0.0:1788833013.828697:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.828731:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.828925:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265839744 00000100:00100000:2.0:1788833013.828931:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265839744 00000100:00100000:2.0:1788833013.828966:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788833013.828975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839744:12345-0@lo:502: 00000100:00100000:2.0:1788833013.829139:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839744:12345-0@lo:502: Request processed in 165us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.829146:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788833013.829296:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839744:0@lo:502: 00000040:00080000:2.0:1788833013.829398:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788833013.829409:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788833013.830139:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788833013.830147:0:7601:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788833013.830279:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833013.830283:0:7601:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788833013.830290:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788833013.830304:0:7601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cea3f710000) 00000020:00000080:0.0:1788833013.830323:0:7601:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788833013.830328:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788833013.830394:0:7601:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea06626000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788833013.830402:0:7601:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788833013.830409:0:7601:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c08e876ed3fe8ac 00010000:00010000:0.0:1788833013.834624:0:7601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788833013.834965:0:7601:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788833013.837689:0:7601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788833013.838080:0:7601:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788833013.843018:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788833013.843868:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788833013.845228:0:7601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788833013.845238:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833013.845244:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833013.845246:0:7601:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788833013.845248:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788833013.845251:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833013.845253:0:7601:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788833013.845255:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788833013.845257:0:7601:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788833013.845303:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833013.845306:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833013.845307:0:7601:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788833013.845311:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788833013.846894:0:7593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788833013.846927:0:7593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788833013.846952:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.846966:0:7593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833013.846975:0:7593:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea06626000 from 1 10000000:01000000:2.0:1788833013.846978:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788833013.847011:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.847020:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.847053:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.847079:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839872:0@lo:101: 00000100:00100000:2.0:1788833013.847141:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.847190:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.847213:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265839872 00000100:00100000:2.0:1788833013.847219:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265839872 00000100:00100000:2.0:1788833013.847259:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788833013.847266:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:7593:x1875727265839872:12345-0@lo:101: 00010000:00010000:2.0:1788833013.847279:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833013.847297:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe8b3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.847320:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.847331:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.847350:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516000, rc 0) 00000100:00100000:2.0:1788833013.847388:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265839872:12345-0@lo:101: Request processed in 122us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.847395:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788833013.847439:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265839872:0@lo:101: 00010000:00010000:2.0:1788833013.847451:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.847461:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.847539:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840000:0@lo:501: 00000100:00100000:2.0:1788833013.847561:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.847582:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833013.848894:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840000 00000100:00100000:0.0:1788833013.848904:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840000 00000100:00100000:0.0:1788833013.848943:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788833013.848951:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840000:12345-0@lo:501: 00000100:00100000:0.0:1788833013.849328:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840000:12345-0@lo:501: Request processed in 377us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833013.849346:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788833013.850093:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840000:0@lo:501: 00000100:00100000:2.0:1788833013.850151:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840128:0@lo:503: 00000100:00100000:2.0:1788833013.850897:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.850945:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833013.851162:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840128 00000100:00100000:1.0:1788833013.851169:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840128 00000100:00100000:1.0:1788833013.851296:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788833013.851305:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840128:12345-0@lo:503: 00000100:00100000:1.0:1788833013.851692:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840128:12345-0@lo:503: Request processed in 387us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833013.851710:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788833013.851915:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840128:0@lo:503: 00000040:00080000:2.0:1788833013.852489:0:7593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788833013.852558:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840256:0@lo:502: 00000100:00100000:2.0:1788833013.852610:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.852650:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833013.852904:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840256 00000100:00100000:0.0:1788833013.852911:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840256 00000100:00100000:0.0:1788833013.852950:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788833013.852959:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840256:12345-0@lo:502: 00000100:00100000:0.0:1788833013.853611:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840256:12345-0@lo:502: Request processed in 651us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833013.853619:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788833013.853858:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840256:0@lo:502: 00000040:00080000:2.0:1788833013.854983:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788833013.855083:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788833013.855124:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840384:0@lo:502: 00000100:00100000:2.0:1788833013.855265:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.855305:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833013.855423:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840384 00000100:00100000:0.0:1788833013.855429:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840384 00000100:00100000:0.0:1788833013.855469:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788833013.855477:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840384:12345-0@lo:502: 00000100:00100000:0.0:1788833013.855642:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840384:12345-0@lo:502: Request processed in 165us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833013.855649:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788833013.855743:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840384:0@lo:502: 00000040:00080000:1.0:1788833013.855913:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788833013.855925:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788833013.856828:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833013.856837:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833013.856840:0:7605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788833013.856847:0:7605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea06626000 00000020:00000080:1.0:1788833013.856849:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788833013.856867:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833013.856871:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833013.856872:0:7605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788833013.856875:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788833013.857428:0:7593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788833013.857452:0:7593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788833013.857466:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.857477:0:7593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833013.857528:0:7593:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788833013.857531:0:7593:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cea06626000 10000000:01000000:0.0:1788833013.857534:0:7593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cea06626000 10000000:01000000:0.0:1788833013.857538:0:7593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788833013.857543:0:7593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea06626000 from 1 10000000:01000000:0.0:1788833013.857545:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788833013.857572:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.857580:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833013.857590:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.857608:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840512:0@lo:101: 00000100:00100000:0.0:1788833013.857661:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.857702:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.857756:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840512 00000100:00100000:2.0:1788833013.857762:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840512 00000100:00100000:2.0:1788833013.857812:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788833013.857821:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265840512:12345-0@lo:101: 00010000:00010000:2.0:1788833013.857833:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833013.857844:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe8c1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.857867:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.857877:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.857885:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517e00, rc 0) 00000100:00100000:2.0:1788833013.857922:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265840512:12345-0@lo:101: Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.857928:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788833013.857979:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840512:0@lo:101: 00010000:00010000:2.0:1788833013.857992:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.858000:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.858104:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840640:0@lo:501: 00000100:00100000:2.0:1788833013.858130:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.858145:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.858159:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840640 00000100:00100000:2.0:1788833013.858163:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840640 00000100:00100000:2.0:1788833013.858196:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788833013.858202:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265840640:12345-0@lo:501: 00000100:00100000:2.0:1788833013.858415:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265840640:12345-0@lo:501: Request processed in 211us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.858422:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788833013.858456:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840640:0@lo:501: 00000100:00100000:2.0:1788833013.858482:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840768:0@lo:503: 00000100:00100000:2.0:1788833013.858518:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.858532:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.858545:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840768 00000100:00100000:2.0:1788833013.858548:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840768 00000100:00100000:2.0:1788833013.858570:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788833013.858575:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265840768:12345-0@lo:503: 00000100:00100000:2.0:1788833013.858716:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265840768:12345-0@lo:503: Request processed in 140us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.858732:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788833013.858772:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840768:0@lo:503: 00000040:00080000:2.0:1788833013.859010:0:7593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788833013.859082:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840896:0@lo:502: 00000100:00100000:2.0:1788833013.859114:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.859129:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.859142:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265840896 00000100:00100000:2.0:1788833013.859145:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265840896 00000100:00100000:2.0:1788833013.859166:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788833013.859172:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265840896:12345-0@lo:502: 00000100:00100000:2.0:1788833013.859324:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265840896:12345-0@lo:502: Request processed in 151us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.859331:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788833013.859384:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265840896:0@lo:502: 00000040:00080000:2.0:1788833013.859604:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788833013.859650:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788833013.859685:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788833013.859733:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788833013.859769:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788833013.859830:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788833013.859869:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788833013.859905:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788833013.859963:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788833013.860002:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788833013.860063:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788833013.860114:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788833013.860149:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788833013.860183:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788833013.860256:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788833013.860296:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788833013.860328:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788833013.860392:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788833013.860428:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788833013.860460:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788833013.860505:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788833013.860536:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788833013.860561:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788833013.863453:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788833013.863549:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788833013.863591:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788833013.863640:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788833013.863679:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788833013.863713:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788833013.863861:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788833013.863901:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788833013.863939:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788833013.863973:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788833013.864022:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788833013.864257:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788833013.864316:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788833013.864373:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788833013.864422:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265841024:0@lo:502: 00000100:00100000:2.0:1788833013.864496:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.864585:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833013.865398:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841024 00000100:00100000:0.0:1788833013.865406:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841024 00000100:00100000:0.0:1788833013.865456:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788833013.865465:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265841024:12345-0@lo:502: 00000100:00100000:0.0:1788833013.865759:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265841024:12345-0@lo:502: Request processed in 294us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833013.865767:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788833013.865939:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265841024:0@lo:502: 00000040:00080000:3.0:1788833013.866260:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788833013.866274:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788833013.866896:0:7606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788833013.866911:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cea068a0000) 00000020:00000080:1.0:1788833013.866933:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788833013.867001:0:7606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea06626000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788833013.867005:0:7606:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea06626000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788833013.867007:0:7606:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea06626000 3 00010000:00080000:1.0:1788833013.869000:0:7606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea3b3e0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1788833013.871399:0:7606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788833013.871645:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788833013.871684:0:7606:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788833013.871696:0:7606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8c08e876ed3fe8d6 00000100:00080000:1.0:1788833013.871707:0:7606:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788833013.871712:0:7606:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cea3b3e0800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1788833013.871744:0:7606:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea269c9c00 x1875727265841152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788833013.871781:0:7606:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788833013.871937:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875727265841152:0@lo:38: 00000100:00100000:3.0:1788833013.872065:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788833013.872245:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788833013.872359:0:7593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788833013.872395:0:7593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:0.0:1788833013.872403:0:7607:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9cea40d81f80 x1875727265841664/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788833013.872412:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833013.872435:0:7593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.872437:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 0 seconds 00000020:01000004:3.0:1788833013.872509:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788833013.872511:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788833013.872512:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833013.872513:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833013.872514:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833013.872516:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833013.872517:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833013.872519:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788833013.872520:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788833013.872522:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833013.872523:0:7593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788833013.872526:0:7593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788833013.872529:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788833013.872530:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788833013.872531:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833013.872532:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833013.872533:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833013.872534:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833013.872535:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833013.872536:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788833013.872537:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788833013.872538:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833013.872539:0:7593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788833013.872553:0:7593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788833013.872563:0:7593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0674b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265841792:0@lo:253: 00000100:00100000:1.0:1788833013.872572:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265841280:0@lo:400: 00000100:00100000:3.0:1788833013.872608:0:7593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833013.872616:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833013.872637:0:7593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea094f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788833013.872653:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833013.872660:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265841408:0@lo:400: 00000100:00100000:1.0:1788833013.872682:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833013.872743:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841792 00000100:00100000:0.0:1788833013.872750:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841792 00000100:00100000:0.0:1788833013.872838:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788833013.872848:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7593:x1875727265841792:12345-0@lo:253: 20000000:01000000:0.0:1788833013.872874:0:5806:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788833013.872886:0:5806:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788833013.872973:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841152 00000100:00100000:2.0:1788833013.872978:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841152 00000100:00100000:2.0:1788833013.872992:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841280 00000100:00100000:2.0:1788833013.872994:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841280 00000100:00100000:2.0:1788833013.873009:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841408 00000100:00100000:2.0:1788833013.873011:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841408 00000100:00100000:2.0:1788833013.873206:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788833013.873214:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265841280:12345-0@lo:400: 00000100:00080000:3.0:1788833013.873227:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833013.873270:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265841280:12345-0@lo:400: Request processed in 56us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.873277:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788833013.873292:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833013.873298:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265841408:12345-0@lo:400: 00000100:00100000:2.0:1788833013.873323:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265841408:12345-0@lo:400: Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.873329:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833013.873407:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833013.873411:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3275:x1875727265841152:12345-0@lo:38: 00010000:00080000:2.0:1788833013.873429:0:5812:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1788833013.873459:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8c08e876ed3fe8dd 00000004:00100000:2.0:1788833013.873472:0:5812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788833013.873498:0:5812:0:(import.c:65:import_set_state_nolock()) ffff9cea06623800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833013.873534:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875727265841152:12345-0@lo:38: Request processed in 121us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.873540:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788833013.873559:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea269c9c00 x1875727265841152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833013.873562:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265841536:0@lo:400: 00000100:00100000:1.0:1788833013.873569:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788833013.873576:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788833013.873583:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788833013.873587:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:2.0:1788833013.873589:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788833013.873589:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea3b3e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788833013.873595:0:3275:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000079272548): req@ffff9cea40d81f80 x1875727265841664/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833013.873609:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875727265841152:0@lo:38: 00000100:00100000:0.0:1788833013.873693:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.873701:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841536 00000100:00100000:2.0:1788833013.873706:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841536 00000100:00100000:0.0:1788833013.873763:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833013.873868:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841664 00000100:00100000:1.0:1788833013.873873:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841664 00000100:00100000:1.0:1788833013.873974:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833013.873984:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7607:x1875727265841664:12345-0@lo:901: 00000100:00100000:1.0:1788833013.874428:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7607:x1875727265841664:12345-0@lo:901: Request processed in 446us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833013.874436:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788833013.875239:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40d83100 x1875727265841408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833013.875255:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265841408:0@lo:400: 00010000:00080000:3.0:1788833013.875268:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40d80000 x1875727265841280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833013.875290:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265841280:0@lo:400: 00010000:00080000:0.0:1788833013.875703:0:7607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40d81f80 x1875727265841664/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788833029 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833013.875715:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7607:1875727265841664:0@lo:901: 00000100:00100000:2.0:1788833013.876569:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833013.876584:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265841536:12345-0@lo:400: 00000100:00100000:2.0:1788833013.876683:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265841536:12345-0@lo:400: Request processed in 104us (3092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.876850:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788833013.876893:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40d82a00 x1875727265841536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833013.876906:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265841536:0@lo:400: 00000100:00080000:2.0:1788833013.876928:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788833013.876932:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 20000000:01000000:2.0:1788833013.897169:0:5806:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788833013.897196:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788833013.897218:0:5828:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788833013.897222:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788833013.897244:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897262:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897271:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897308:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897321:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 14 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.897344:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1875727265841920:0@lo:104: 00000100:00100000:2.0:1788833013.897398:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.897433:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f2216c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833013.897449:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265841920 00000100:00100000:2.0:1788833013.897467:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265841920 00000100:00100000:2.0:1788833013.897505:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833013.897512:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5828:x1875727265841920:12345-0@lo:104: 00010000:00010000:2.0:1788833013.897523:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897567:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833013.897572:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:5828:x1875727265841920:12345-0@lo:104: Request processed in 61us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.897578:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788833013.897594:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833013.897599:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897606:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476400 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833013.897609:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897617:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833013.897623:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833013.897629:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833013.897656:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897662:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833013.897676:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897689:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe82e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe835 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897704:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833013.897706:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833013.897708:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833013.897737:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265842048:0@lo:103: 00000100:00100000:2.0:1788833013.897764:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833013.897800:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842048 00000100:00100000:2.0:1788833013.897804:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842048 00010000:00010000:2.0:1788833013.897818:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 15 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.897835:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833013.897840:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:3279:x1875727265842048:12345-0@lo:103: 00010000:00010000:2.0:1788833013.897849:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833013.897853:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 15 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897862:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 15 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897877:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897884:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788833013.897896:0:5799:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001981656s 00010000:00010000:2.0:1788833013.897906:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897914:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897921:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897927:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897932:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833013.897936:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897943:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897951:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.897960:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833013.897988:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:3279:x1875727265842048:12345-0@lo:103: Request processed in 147us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833013.897995:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833013.898076:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265842048:0@lo:103: 00010000:00010000:2.0:1788833013.898101:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea42166c00/0x8c08e876ed3fe835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe82e expref: 14 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833013.898112:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5828:1875727265841920:0@lo:104: 00010000:00010000:2.0:1788833013.898131:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.898138:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.898144:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833013.898150:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517400/0x8c08e876ed3fe8e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833013.907086:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:7593:x1875727265841792:12345-0@lo:253: Request processed in 34230us (34469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833013.907101:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788833013.907299:0:7593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0674b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7593:1875727265841792:0@lo:253: 10000000:01000000:3.0:1788833013.907314:0:7593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788833013.907318:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788833013.907319:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788833013.907320:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833013.907321:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833013.907322:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833013.907324:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833013.907325:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833013.907327:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788833013.907328:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788833013.907330:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833013.907342:0:7593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788833013.907358:0:7593:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788833013.913140:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833013.913449:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833013.913681:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833013.913938:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833013.914264:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833013.914542:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788833013.915911:0:7593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788833014.137941:0:7593:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788833014.137948:0:7593:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788833014.138128:0:7593:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788833014.138255:0:7593:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788833014.138270:0:7593:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788833014.138293:0:7593:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788833014.770239:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833015.789369:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833015.917350:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0674b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265842176:0@lo:13: 00000100:00100000:1.0:1788833015.917420:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833015.917560:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842176 00000100:00100000:0.0:1788833015.917568:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842176 00000100:00100000:0.0:1788833015.917637:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833015.917646:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265842176:12345-0@lo:13: 00002000:00000024:0.0:1788833015.917677:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788833015.917738:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788833015.922562:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea0674b480 x1875727265842176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833015.922597:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0674b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265842176:0@lo:13: 00000100:00100000:0.0:1788833015.922653:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265842176:12345-0@lo:13: Request processed in 4731us (4956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833015.922671:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788833016.813478:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833017.839469:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833018.864538:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833018.989693:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265842304:0@lo:400: 00000100:00100000:2.0:1788833018.989759:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833018.989808:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265842816:0@lo:400: 00000100:00100000:2.0:1788833018.989842:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833018.989872:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788833018.989890:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265842688:0@lo:400: 00000100:00100000:2.0:1788833018.989920:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833018.989963:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265842432:0@lo:400: 00000100:00100000:2.0:1788833018.989992:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833018.990009:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833018.990019:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265842560:0@lo:400: 00000100:00100000:2.0:1788833018.990056:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833018.990088:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842304 00000100:00100000:2.0:1788833018.990095:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842304 00000100:00100000:2.0:1788833018.990289:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788833018.990299:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3277:x1875727265842304:12345-0@lo:400: 00000100:00100000:2.0:1788833018.990356:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3277:x1875727265842304:12345-0@lo:400: Request processed in 58us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833018.990363:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788833018.990393:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842816 00000100:00100000:2.0:1788833018.990397:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842816 00000100:00100000:2.0:1788833018.990422:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842432 00000100:00100000:2.0:1788833018.990425:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842432 00000100:00100000:2.0:1788833018.990435:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842560 00000100:00100000:2.0:1788833018.990437:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842560 00000100:00100000:2.0:1788833018.990449:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833018.990456:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265842816:12345-0@lo:400: 00000100:00100000:2.0:1788833018.990486:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265842816:12345-0@lo:400: Request processed in 31us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833018.990491:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833018.990502:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833018.990508:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265842432:12345-0@lo:400: 00000100:00100000:2.0:1788833018.990537:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265842432:12345-0@lo:400: Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833018.990948:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833018.990977:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833018.990983:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265842560:12345-0@lo:400: 00000100:00100000:2.0:1788833018.991024:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265842560:12345-0@lo:400: Request processed in 41us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833018.991080:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833018.991103:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842688 00000100:00100000:2.0:1788833018.991107:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842688 00000100:00100000:2.0:1788833018.991133:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833018.991139:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265842688:12345-0@lo:400: 00000100:00100000:2.0:1788833018.991418:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265842688:12345-0@lo:400: Request processed in 277us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833018.991430:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788833018.991452:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833018.991456:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788833018.991482:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05caad80 x1875727265842560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833018.991496:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265842560:0@lo:400: 00010000:00080000:2.0:1788833018.991508:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05cab800 x1875727265842432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833018.991517:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265842432:0@lo:400: 00010000:00080000:2.0:1788833018.991549:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05ca9c00 x1875727265842688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833018.991558:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265842688:0@lo:400: 00000100:00100000:2.0:1788833018.991567:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265842304:0@lo:400: 00010000:00080000:2.0:1788833018.991577:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05ca8a80 x1875727265842816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833018.991592:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265842816:0@lo:400: 00000001:02000400:1.0:1788833019.741835:0:7950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788833019.886126:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788833020.526016:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788833020.526023:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea1fc5c800 from 30 10000000:01000000:0.0:1788833020.526057:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788833020.526097:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.526108:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.526120:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.526153:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265842944:0@lo:101: 00000100:00100000:0.0:1788833020.526212:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.526255:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23840 going to sleep for 11 seconds 00000100:00100000:1.0:1788833020.526672:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265842944 00000100:00100000:1.0:1788833020.526680:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265842944 00000100:00100000:1.0:1788833020.526725:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788833020.526879:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265842944:12345-0@lo:101: 00010000:00010000:1.0:1788833020.526894:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833020.526909:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe8eb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.526935:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.526946:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.526955:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e800, rc 0) 00000100:00100000:1.0:1788833020.527055:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265842944:12345-0@lo:101: Request processed in 322us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833020.527062:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788833020.527383:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265842944:0@lo:101: 00010000:00010000:0.0:1788833020.527400:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.527408:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.527463:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843072:0@lo:501: 00000100:00100000:0.0:1788833020.527495:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.529114:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23840 going to sleep for 11 seconds 00000100:00100000:3.0:1788833020.529538:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843072 00000100:00100000:3.0:1788833020.529546:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843072 00000100:00100000:3.0:1788833020.529665:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788833020.529676:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265843072:12345-0@lo:501: 00000100:00100000:3.0:1788833020.530056:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265843072:12345-0@lo:501: Request processed in 355us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833020.530064:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788833020.530921:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843072:0@lo:501: 00000100:00100000:1.0:1788833020.530972:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843200:0@lo:503: 00000100:00100000:1.0:1788833020.531046:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833020.531080:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea10a7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.531080:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843200 00000100:00100000:0.0:1788833020.531086:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843200 00000100:00100000:0.0:1788833020.531132:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788833020.531142:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265843200:12345-0@lo:503: 00000100:00100000:0.0:1788833020.531974:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265843200:12345-0@lo:503: Request processed in 830us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.531983:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788833020.532325:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843200:0@lo:503: 00000100:00100000:1.0:1788833020.534929:0:7996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7996:1875727265843328:0@lo:502: 00000100:00100000:1.0:1788833020.535012:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833020.535082:0:7996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea10a7dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.537202:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843328 00000100:00100000:0.0:1788833020.537216:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843328 00000100:00100000:0.0:1788833020.537267:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788833020.537276:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7996:x1875727265843328:12345-0@lo:502: 00000100:00100000:0.0:1788833020.537656:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7996:x1875727265843328:12345-0@lo:502: Request processed in 381us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.537664:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788833020.537699:0:7996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7996:1875727265843328:0@lo:502: 00000100:00100000:3.0:1788833020.537775:0:7996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7996:1875727265843456:0@lo:502: 00000100:00100000:3.0:1788833020.537817:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833020.537854:0:7996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea033240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.539190:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843456 00000100:00100000:0.0:1788833020.539201:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843456 00000100:00100000:0.0:1788833020.539245:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788833020.539254:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7996:x1875727265843456:12345-0@lo:502: 00000100:00100000:0.0:1788833020.539498:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:7996:x1875727265843456:12345-0@lo:502: Request processed in 244us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.539506:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788833020.539581:0:7996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7996:1875727265843456:0@lo:502: 00000040:00080000:0.0:1788833020.539613:0:7996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788833020.540060:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788833020.540083:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788833020.540091:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.540103:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833020.540122:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788833020.540124:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788833020.540127:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788833020.540213:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.540222:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.540231:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.540248:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843584:0@lo:101: 00000100:00100000:0.0:1788833020.540285:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.540329:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.540348:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843584 00000100:00100000:0.0:1788833020.540352:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843584 00000100:00100000:0.0:1788833020.540380:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788833020.540388:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265843584:12345-0@lo:101: 00010000:00010000:0.0:1788833020.540397:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833020.540410:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe8f9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.540448:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.540459:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.540478:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477800, rc 0) 00000100:00100000:0.0:1788833020.540511:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265843584:12345-0@lo:101: Request processed in 124us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.540518:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788833020.541122:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843584:0@lo:101: 00010000:00010000:0.0:1788833020.541306:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.541317:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.541369:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843712:0@lo:501: 00000100:00100000:0.0:1788833020.541402:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.541421:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.541438:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843712 00000100:00100000:0.0:1788833020.541442:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843712 00000100:00100000:0.0:1788833020.541805:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788833020.541815:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265843712:12345-0@lo:501: 00000100:00100000:0.0:1788833020.542800:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265843712:12345-0@lo:501: Request processed in 321us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.542812:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788833020.542862:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843712:0@lo:501: 00000100:00100000:0.0:1788833020.542984:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843840:0@lo:503: 00000100:00100000:0.0:1788833020.543334:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.543403:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833020.543444:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843840 00000100:00100000:1.0:1788833020.543451:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843840 00000100:00100000:1.0:1788833020.543521:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788833020.543531:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265843840:12345-0@lo:503: 00000100:00100000:1.0:1788833020.544370:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265843840:12345-0@lo:503: Request processed in 838us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833020.544378:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788833020.544448:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265843840:0@lo:503: 00000100:00100000:0.0:1788833020.548976:0:7999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7999:1875727265843968:0@lo:502: 00000100:00100000:0.0:1788833020.549206:0:7999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.549284:0:7999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788833020.550672:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265843968 00000100:00100000:1.0:1788833020.550684:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265843968 00000100:00100000:1.0:1788833020.550828:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788833020.550839:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7999:x1875727265843968:12345-0@lo:502: 00000100:00100000:1.0:1788833020.551377:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7999:x1875727265843968:12345-0@lo:502: Request processed in 538us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833020.551386:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788833020.551595:0:7999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7999:1875727265843968:0@lo:502: 00000020:01000000:3.0:1788833020.551642:0:7999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788833020.551651:0:7999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833020.551654:0:7999:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788833020.551659:0:7999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788833020.551661:0:7999:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788833020.551690:0:7999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7999:1875727265844096:0@lo:502: 00000100:00100000:3.0:1788833020.551835:0:7999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833020.551952:0:7999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea033240c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833020.551987:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844096 00000100:00100000:1.0:1788833020.551994:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844096 00000100:00100000:1.0:1788833020.552103:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788833020.552113:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7999:x1875727265844096:12345-0@lo:502: 00000100:00100000:1.0:1788833020.552437:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:7999:x1875727265844096:12345-0@lo:502: Request processed in 326us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833020.552446:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788833020.552518:0:7999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:7999:1875727265844096:0@lo:502: 00000020:01000000:3.0:1788833020.552552:0:7999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788833020.552558:0:7999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833020.552559:0:7999:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788833020.552563:0:7999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788833020.552826:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788833020.552845:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788833020.552860:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.552943:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833020.553471:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788833020.553475:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea100dd800 from 30 10000000:01000000:1.0:1788833020.553478:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788833020.553507:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.553516:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.553525:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833020.553803:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844224:0@lo:101: 00000100:00100000:1.0:1788833020.553852:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833020.553991:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea10a7dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.554122:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844224 00000100:00100000:0.0:1788833020.554128:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844224 00000100:00100000:0.0:1788833020.554182:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788833020.554191:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265844224:12345-0@lo:101: 00010000:00010000:0.0:1788833020.554202:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833020.554215:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe907 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.554237:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.554247:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.554255:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476800, rc 0) 00000100:00100000:0.0:1788833020.554292:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265844224:12345-0@lo:101: Request processed in 103us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.554307:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788833020.563564:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844224:0@lo:101: 00010000:00010000:0.0:1788833020.563592:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.563606:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.563689:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844352:0@lo:501: 00000100:00100000:0.0:1788833020.563757:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.563808:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788833020.563999:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844352 00000100:00100000:3.0:1788833020.564005:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844352 00000100:00100000:3.0:1788833020.564076:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788833020.564087:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265844352:12345-0@lo:501: 00000100:00100000:3.0:1788833020.564358:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265844352:12345-0@lo:501: Request processed in 273us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833020.564366:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788833020.564781:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844352:0@lo:501: 00000100:00100000:0.0:1788833020.564819:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844480:0@lo:503: 00000100:00100000:0.0:1788833020.564865:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.564914:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788833020.565100:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844480 00000100:00100000:3.0:1788833020.565106:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844480 00000100:00100000:3.0:1788833020.565136:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788833020.565151:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265844480:12345-0@lo:503: 00000100:00100000:3.0:1788833020.565316:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265844480:12345-0@lo:503: Request processed in 173us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833020.565323:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788833020.565481:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844480:0@lo:503: 00000100:00100000:1.0:1788833020.565981:0:8004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8004:1875727265844608:0@lo:502: 00000100:00100000:1.0:1788833020.566023:0:8004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833020.566083:0:8004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea10a7df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.566137:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844608 00000100:00100000:0.0:1788833020.566149:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844608 00000100:00100000:0.0:1788833020.566185:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788833020.566192:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8004:x1875727265844608:12345-0@lo:502: 00000100:00100000:0.0:1788833020.566367:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8004:x1875727265844608:12345-0@lo:502: Request processed in 175us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.566375:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788833020.566554:0:8004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8004:1875727265844608:0@lo:502: 00000100:00100000:1.0:1788833020.566595:0:8004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8004:1875727265844736:0@lo:502: 00000100:00100000:1.0:1788833020.566629:0:8004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833020.566654:0:8004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea10a7df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788833020.566691:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844736 00000100:00100000:3.0:1788833020.566701:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844736 00000100:00100000:3.0:1788833020.566741:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788833020.566748:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8004:x1875727265844736:12345-0@lo:502: 00000100:00100000:3.0:1788833020.567166:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8004:x1875727265844736:12345-0@lo:502: Request processed in 280us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833020.567175:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788833020.571371:0:8004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8004:1875727265844736:0@lo:502: 00000040:00080000:1.0:1788833020.571422:0:8004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788833020.575272:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788833020.575312:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788833020.575324:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.575336:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833020.575346:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788833020.575348:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea100dd800 from 5 10000000:01000000:0.0:1788833020.575357:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788833020.575391:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.575399:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.575410:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.575434:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844864:0@lo:101: 00000100:00100000:0.0:1788833020.575495:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833020.575622:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844864 00000100:00100000:1.0:1788833020.575631:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844864 00000100:00100000:1.0:1788833020.575679:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788833020.575686:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265844864:12345-0@lo:101: 00010000:00010000:1.0:1788833020.575697:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833020.575710:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932ee00/0x8c08e876ed3fe91c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe915 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.575742:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932ee00/0x8c08e876ed3fe91c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe915 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.575752:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932ee00/0x8c08e876ed3fe91c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe915 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.575761:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932ee00, rc 0) 00000100:00100000:1.0:1788833020.575794:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265844864:12345-0@lo:101: Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833020.575800:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788833020.575960:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.575981:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844864:0@lo:101: 00010000:00010000:0.0:1788833020.576002:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.576010:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.576085:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844992:0@lo:256: 00000100:00100000:0.0:1788833020.576114:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.576131:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833020.576705:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265844992 00000100:00100000:2.0:1788833020.576712:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265844992 00000100:00100000:2.0:1788833020.576757:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788833020.576765:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265844992:12345-0@lo:256: 20000000:01000000:2.0:1788833020.576782:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788833020.576798:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788833020.576801:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788833020.576913:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265844992:12345-0@lo:256: Request processed in 148us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833020.576920:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788833020.576978:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265844992:0@lo:256: 10000000:01000000:0.0:1788833020.577024:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788833020.577049:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.577058:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833020.577071:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788833020.577073:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788833020.577076:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788833020.577098:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.577105:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833020.577113:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833020.577126:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845120:0@lo:101: 00000100:00100000:0.0:1788833020.577164:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.577188:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833020.577308:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265845120 00000100:00100000:1.0:1788833020.577313:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265845120 00000100:00100000:1.0:1788833020.577376:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788833020.577383:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265845120:12345-0@lo:101: 00010000:00010000:1.0:1788833020.577392:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833020.577403:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe923 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.577421:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.577443:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833020.577450:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f600, rc 0) 00000100:00100000:1.0:1788833020.577483:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265845120:12345-0@lo:101: Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833020.577489:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788833020.579171:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845120:0@lo:101: 00010000:00010000:2.0:1788833020.579194:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.579206:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833020.579281:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845248:0@lo:501: 00000100:00100000:2.0:1788833020.579363:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833020.582997:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea096dc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.583997:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265845248 00000100:00100000:0.0:1788833020.584009:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265845248 00000100:00100000:0.0:1788833020.584067:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788833020.584077:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265845248:12345-0@lo:501: 00000100:00100000:0.0:1788833020.587767:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265845248:12345-0@lo:501: Request processed in 3432us (8143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.587853:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788833020.588173:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845248:0@lo:501: 00000100:00100000:0.0:1788833020.588220:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845376:0@lo:503: 00000100:00100000:0.0:1788833020.588278:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.588317:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833020.588789:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265845376 00000100:00100000:2.0:1788833020.588798:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265845376 00000100:00100000:2.0:1788833020.588859:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788833020.588867:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265845376:12345-0@lo:503: 00000100:00100000:2.0:1788833020.589381:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265845376:12345-0@lo:503: Request processed in 514us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833020.589389:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788833020.589429:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845376:0@lo:503: 00000100:00100000:0.0:1788833020.593618:0:8007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8007:1875727265845504:0@lo:502: 00000100:00100000:0.0:1788833020.593713:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.593766:0:8007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea095fc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788833020.593821:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265845504 00000100:00100000:1.0:1788833020.593829:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265845504 00000100:00100000:1.0:1788833020.593949:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788833020.593959:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8007:x1875727265845504:12345-0@lo:502: 00000100:00100000:0.0:1788833020.594376:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8007:x1875727265845504:12345-0@lo:502: Request processed in 417us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.594384:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788833020.594396:0:8007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8007:1875727265845504:0@lo:502: 00000020:01000000:1.0:1788833020.594422:0:8007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788833020.594429:0:8007:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788833020.594436:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833020.594438:0:8007:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788833020.594446:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788833020.594450:0:8007:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:1.0:1788833020.594470:0:8007:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788833020.594473:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788833020.594485:0:8007:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cea068a4d28) 00000020:00000080:1.0:1788833020.594506:0:8007:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788833020.594511:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788833020.594586:0:8007:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788833020.594591:0:8007:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788833020.594597:0:8007:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3fe938 00010000:00080000:1.0:1788833020.594631:0:8007:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea3f4b6000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1788833020.595063:0:8007:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788833020.598390:0:8007:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788833020.598407:0:8007:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788833020.598989:0:8007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833020.599246:0:8007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833020.599294:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788833020.599377:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788833020.600191:0:8008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788833020.600196:0:8008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788833020.601133:0:8007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788833020.601148:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788833020.601185:0:8007:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788833020.601205:0:8007:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3fe93f 00000100:00080000:0.0:1788833020.601215:0:8007:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788833020.601220:0:8007:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cea3f4b6000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1788833020.601252:0:8007:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40d81500 x1875727265845632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788833020.601285:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265845632:0@lo:8: 00000100:00100000:0.0:1788833020.601365:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788833020.601426:0:8007:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788833020.601721:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265845632 00000100:00100000:2.0:1788833020.601728:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265845632 00000100:00100000:2.0:1788833020.601760:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833020.601767:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3275:x1875727265845632:12345-0@lo:8: 00010000:00080000:2.0:1788833020.601802:0:6655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1788833020.601823:0:6655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3fe946 00002000:00100000:2.0:1788833020.601835:0:6655:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ce901273000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788833020.601839:0:6655:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788833020.601843:0:6655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788833020.601953:0:6655:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1788833020.602310:0:8007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833020.602316:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833020.602318:0:8007:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788833020.602321:0:8007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788833020.602324:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833020.602326:0:8007:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788833020.602328:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788833020.602330:0:8007:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788833020.602358:0:8007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8007:1875727265845760:0@lo:502: 00000100:00100000:0.0:1788833020.602407:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.602454:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265845760 00000100:00100000:0.0:1788833020.602460:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265845760 00000100:00100000:0.0:1788833020.602491:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788833020.602498:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8007:x1875727265845760:12345-0@lo:502: 00000100:00100000:0.0:1788833020.602697:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8007:x1875727265845760:12345-0@lo:502: Request processed in 199us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.602703:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788833020.602735:0:8007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea094f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.602752:0:8007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8007:1875727265845760:0@lo:502: 00000020:01000000:0.0:1788833020.602775:0:8007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833020.602778:0:8007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833020.602780:0:8007:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788833020.602784:0:8007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:2.0:1788833020.603617:0:6655:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788833020.603648:0:6655:0:(import.c:65:import_set_state_nolock()) ffff9ce901270000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833020.603701:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1875727265845632:12345-0@lo:8: Request processed in 1933us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833020.603709:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788833020.603756:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40d81500 x1875727265845632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788833030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833020.603766:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788833020.603772:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788833020.603944:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788833020.603949:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788833020.603959:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea3f4b6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788833020.603968:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788833020.603973:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265845632:0@lo:8: 00000020:01000000:2.0:1788833020.603995:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788833020.604012:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788833020.604020:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.604043:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833020.604053:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788833020.604056:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cea10ad4d28 from 1 10000000:01000000:2.0:1788833020.604058:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788833020.604081:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.604088:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.604097:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833020.604110:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845888:0@lo:101: 00000100:00100000:2.0:1788833020.604346:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833020.604368:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea096dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1788833020.604386:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265845888 00000100:00100000:2.0:1788833020.604391:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265845888 00000100:00100000:2.0:1788833020.604421:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788833020.604434:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265845888:12345-0@lo:101: 00010000:00010000:2.0:1788833020.604449:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833020.604462:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe94d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.604484:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.604571:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.604580:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:2.0:1788833020.604680:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265845888:12345-0@lo:101: Request processed in 252us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833020.604687:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788833020.604722:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265845888:0@lo:101: 00010000:00010000:2.0:1788833020.604733:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.604743:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833020.604859:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265846016:0@lo:501: 00000100:00100000:2.0:1788833020.604883:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833020.604902:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea096dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1788833020.604912:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846016 00000100:00100000:2.0:1788833020.604915:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846016 00000100:00100000:2.0:1788833020.604932:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788833020.604938:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265846016:12345-0@lo:501: 00000100:00100000:2.0:1788833020.605262:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265846016:12345-0@lo:501: Request processed in 195us (251us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788833020.605271:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788833020.605315:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265846016:0@lo:501: 10000000:01000000:2.0:1788833020.605333:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788833020.605339:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833020.605347:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788833020.605369:0:8008:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788833020.605438:0:8008:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 154671406121ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788833020.608101:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265846400:0@lo:400: 00000100:00100000:0.0:1788833020.608165:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.608200:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833020.608206:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265846528:0@lo:400: 00000100:00100000:0.0:1788833020.608227:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.608255:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265846272:0@lo:400: 00000100:00100000:0.0:1788833020.608733:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.608759:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788833020.608766:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265846144:0@lo:400: 00000100:00100000:0.0:1788833020.608788:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.608822:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846528 00000100:00100000:0.0:1788833020.608827:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846528 00000100:00100000:0.0:1788833020.608867:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846272 00000100:00100000:0.0:1788833020.608870:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846272 00000100:00100000:0.0:1788833020.608884:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846144 00000100:00100000:0.0:1788833020.608893:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846144 00000100:00100000:0.0:1788833020.608910:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788833020.608916:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265846528:12345-0@lo:400: 00000100:00100000:0.0:1788833020.608961:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265846528:12345-0@lo:400: Request processed in 44us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.608967:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788833020.608981:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788833020.608986:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265846272:12345-0@lo:400: 00000100:00100000:0.0:1788833020.609013:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265846272:12345-0@lo:400: Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.609018:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788833020.609048:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788833020.609055:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265846144:12345-0@lo:400: 00000100:00100000:0.0:1788833020.609081:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265846144:12345-0@lo:400: Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.609087:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788833020.609108:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788833020.609132:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05ca9880 x1875727265846144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833020.609146:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265846144:0@lo:400: 00010000:00080000:0.0:1788833020.609157:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05ca9c00 x1875727265846272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833020.609164:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265846272:0@lo:400: 00010000:00080000:0.0:1788833020.609193:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05caad80 x1875727265846528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833020.609213:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265846528:0@lo:400: 00000100:00100000:2.0:1788833020.610082:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846400 00000100:00100000:2.0:1788833020.610089:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846400 00000100:00100000:2.0:1788833020.610124:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788833020.610131:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265846400:12345-0@lo:400: 00000100:00100000:2.0:1788833020.610724:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265846400:12345-0@lo:400: Request processed in 592us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833020.610732:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788833020.611948:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788833020.612008:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05cab800 x1875727265846400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833020.612025:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265846400:0@lo:400: 00000004:00080000:2.0:1788833020.672684:0:8009:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788833020.672717:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265846784:0@lo:7: 00000100:00100000:2.0:1788833020.672779:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833020.672815:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea096dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1788833020.672837:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846784 00000100:00100000:2.0:1788833020.672844:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846784 00000100:00100000:2.0:1788833020.672894:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833020.672915:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8009:x1875727265846784:12345-0@lo:7: 00000100:00100000:0.0:1788833020.673534:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265846656:0@lo:13: 00000100:00100000:0.0:1788833020.673572:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788833020.673610:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833020.673624:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846656 00000100:00100000:0.0:1788833020.673628:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846656 00000100:00100000:0.0:1788833020.673669:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833020.673676:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875727265846656:12345-0@lo:13: 00002000:00000024:0.0:1788833020.673697:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788833020.673740:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875727265846656:12345-0@lo:13: Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.673747:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788833020.673785:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05ca8e00 x1875727265846656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833020.673803:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265846656:0@lo:13: 00000004:00080000:3.0:1788833020.674269:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788833020.686415:0:6656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788833020.686424:0:6656:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788833020.686551:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8009:x1875727265846784:12345-0@lo:7: Request processed in 13635us (13769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833020.686572:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788833020.693022:0:8009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05cabb80 x1875727265846784/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788833036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833020.693065:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265846784:0@lo:7: 00000004:00080000:2.0:1788833020.693080:0:8009:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788833020.695188:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265846912:0@lo:5: 00000100:00100000:2.0:1788833020.695246:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833020.695316:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea08a8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.695469:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265846912 00000100:00100000:0.0:1788833020.695476:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265846912 00000100:00100000:0.0:1788833020.695530:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788833020.695539:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8009:x1875727265846912:12345-0@lo:5: 00002000:00080000:0.0:1788833020.695573:0:6655:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788833020.695576:0:6655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788833020.695909:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8009:x1875727265846912:12345-0@lo:5: Request processed in 370us (661us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788833020.695917:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788833020.695954:0:8009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05cabb80 x1875727265846912/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788833036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833020.695969:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265846912:0@lo:5: 00000004:00080000:0.0:1788833020.695978:0:8009:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788833020.696004:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265847040:0@lo:700: 00000100:00100000:0.0:1788833020.696046:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.696072:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847040 00000100:00100000:0.0:1788833020.696076:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847040 00000100:00100000:0.0:1788833020.696102:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833020.696109:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8009:x1875727265847040:12345-0@lo:700: 00000100:00100000:0.0:1788833020.696135:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6662:1875727265847168:0@lo:700: 00000100:00100000:0.0:1788833020.696175:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833020.696192:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea10a7dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833020.696209:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847168 00000100:00100000:0.0:1788833020.696212:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847168 00000100:00100000:0.0:1788833020.696244:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833020.696250:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6662:x1875727265847168:12345-0@lo:700: 00000100:00100000:0.0:1788833020.696711:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea10a7d840 going to sleep for 11 seconds 40000000:02000000:0.0:1788833020.738230:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788833020.748471:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6662:x1875727265847168:12345-0@lo:700: Request processed in 52214us (52287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833020.748485:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788833020.749977:0:6662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40d83100 x1875727265847168/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788833036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833020.749994:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6662:1875727265847168:0@lo:700: 40000000:02000000:1.0:1788833020.750007:0:6662:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788833020.862527:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8009:x1875727265847040:12345-0@lo:700: Request processed in 166410us (166488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833020.862561:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788833020.862623:0:8009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40d82a00 x1875727265847040/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788833036 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833020.862637:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265847040:0@lo:700: 00000001:00080000:3.0:1788833020.862952:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788833020.862972:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1788833020.904827:0:8009:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00010000:00010000:3.0:1788833020.909393:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833020.919482:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265847296:0@lo:5: 00000100:00100000:2.0:1788833020.919549:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833020.919610:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea125386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833020.919671:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847296 00000100:00100000:3.0:1788833020.919680:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847296 00000100:00100000:3.0:1788833020.919739:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788833020.919748:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8009:x1875727265847296:12345-0@lo:5: 00002000:00080000:3.0:1788833020.928405:0:6656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788833020.928426:0:6656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788833020.931879:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8009:x1875727265847296:12345-0@lo:5: Request processed in 12125us (12322us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788833020.931891:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788833020.931992:0:8009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05cab800 x1875727265847296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788833036 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833020.932004:0:8009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788833020.932018:0:8009:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9cea05cab800 x1875727265847296/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788833036 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833020.932343:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8009:1875727265847296:0@lo:5: 00000004:00080000:2.0:1788833020.932357:0:8009:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788833021.037474:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265847424:0@lo:13: 00000100:00100000:0.0:1788833021.037553:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833021.037812:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847424 00000100:00100000:2.0:1788833021.037819:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847424 00000100:00100000:2.0:1788833021.037861:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833021.037870:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265847424:12345-0@lo:13: 00002000:00000024:2.0:1788833021.037902:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833021.038317:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265847424:12345-0@lo:13: Request processed in 447us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833021.038334:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788833021.041495:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea06748380 x1875727265847424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833021.041522:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265847424:0@lo:13: 00010000:00010000:2.0:1788833021.933184:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833022.957304:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833023.981409:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788833024.438374:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788833024.828966:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833024.829915:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256387712 00000100:00100000:2.0:1788833024.829926:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256387712 00000100:00100000:2.0:1788833024.829975:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 110 00000100:00100000:2.0:1788833024.829983:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1875727256387712:12345-192.168.206.55@tcp:250: 00010000:00080000:2.0:1788833024.830008:0:5806:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8e4041fb-b72d-4a84-89ff-1db735bdf82e@192.168.206.55@tcp t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:2.0:1788833024.830059:0:5806:0:(genops.c:1385:class_connect()) connect: client 8e4041fb-b72d-4a84-89ff-1db735bdf82e, cookie 0x8c08e876ed3fe95b 00000100:00080000:2.0:1788833024.830297:0:5806:0:(import.c:65:import_set_state_nolock()) ffff9ce901271000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833024.830413:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+5:2356:x1875727256387712:12345-192.168.206.55@tcp:250: Request processed in 429us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.830421:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 110 00000100:00100000:3.0:1788833024.835582:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833024.835658:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256387840 00000100:00100000:2.0:1788833024.835667:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256387840 00000100:00100000:2.0:1788833024.835731:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 111 00000100:00100000:2.0:1788833024.835741:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+5:5585:x1875727256387840:12345-192.168.206.55@tcp:101: 00010000:00010000:2.0:1788833024.835757:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833024.835773:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ad2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.835799:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.835810:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.835838:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517600, rc 0) 00000100:00100000:2.0:1788833024.836054:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+6:5585:x1875727256387840:12345-192.168.206.55@tcp:101: Request processed in 290us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.836061:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 111 00000100:00100000:3.0:1788833024.839327:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.839362:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256387968 00000100:00100000:3.0:1788833024.839370:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256387968 00000100:00100000:3.0:1788833024.839415:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 112 00000100:00100000:3.0:1788833024.839424:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+6:5585:x1875727256387968:12345-192.168.206.55@tcp:501: 00000100:00100000:3.0:1788833024.839734:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+6:5585:x1875727256387968:12345-192.168.206.55@tcp:501: Request processed in 310us (414us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788833024.839743:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 112 00000100:00100000:0.0:1788833024.846908:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.846979:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388096 00000100:00100000:3.0:1788833024.846987:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388096 00000100:00100000:3.0:1788833024.847053:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 113 00000100:00100000:3.0:1788833024.847062:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+6:5585:x1875727256388096:12345-192.168.206.55@tcp:101: 00010000:00010000:3.0:1788833024.847078:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833024.847092:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ad34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.847118:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.847138:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.847146:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd000, rc 0) 00000100:00100000:3.0:1788833024.847199:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+7:5585:x1875727256388096:12345-192.168.206.55@tcp:101: Request processed in 138us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.847206:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 113 00000100:00100000:3.0:1788833024.848887:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833024.849018:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388224 00000100:00100000:0.0:1788833024.849026:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388224 00000100:00100000:0.0:1788833024.849090:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 114 00000100:00100000:0.0:1788833024.849099:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+7:5585:x1875727256388224:12345-192.168.206.55@tcp:501: 00000100:00100000:0.0:1788833024.849344:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5585:x1875727256388224:12345-192.168.206.55@tcp:501: Request processed in 245us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833024.849353:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 114 00000100:00100000:0.0:1788833024.852388:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.852468:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388352 00000100:00100000:3.0:1788833024.852477:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388352 00000100:00100000:3.0:1788833024.852525:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:3.0:1788833024.852535:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5585:x1875727256388352:12345-192.168.206.55@tcp:503: 00000100:00100000:3.0:1788833024.852845:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5585:x1875727256388352:12345-192.168.206.55@tcp:503: Request processed in 311us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.852929:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:1.0:1788833024.857104:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.857400:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388480 00000100:00100000:3.0:1788833024.857409:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388480 00000100:00100000:3.0:1788833024.857465:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 116 00000100:00100000:3.0:1788833024.857474:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5603:x1875727256388480:12345-192.168.206.55@tcp:502: 00000100:00100000:3.0:1788833024.857787:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5603:x1875727256388480:12345-192.168.206.55@tcp:502: Request processed in 313us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.857796:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 116 00000100:00100000:1.0:1788833024.894932:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.895007:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388608 00000100:00100000:3.0:1788833024.895017:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388608 00000100:00100000:3.0:1788833024.895088:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 117 00000100:00100000:3.0:1788833024.895098:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5603:x1875727256388608:12345-192.168.206.55@tcp:502: 00000100:00100000:3.0:1788833024.895345:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5603:x1875727256388608:12345-192.168.206.55@tcp:502: Request processed in 248us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.895353:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 117 00000100:00100000:3.0:1788833024.900794:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833024.901075:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388736 00000100:00100000:2.0:1788833024.901086:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388736 00000100:00100000:2.0:1788833024.901144:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 118 00000100:00100000:2.0:1788833024.901156:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5585:x1875727256388736:12345-192.168.206.55@tcp:101: 00010000:00010000:2.0:1788833024.901173:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833024.901191:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01516a00/0x8c08e876ed3fe970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ad5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.901347:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516a00/0x8c08e876ed3fe970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad5e expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.901361:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01516a00/0x8c08e876ed3fe970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad5e expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.901371:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516a00, rc 0) 00000100:00100000:2.0:1788833024.901424:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5585:x1875727256388736:12345-192.168.206.55@tcp:101: Request processed in 270us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.901432:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 118 00000100:00100000:1.0:1788833024.907189:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833024.907777:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388864 00000100:00100000:0.0:1788833024.907788:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388864 00000100:00100000:0.0:1788833024.907879:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 119 00000100:00100000:0.0:1788833024.907889:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5585:x1875727256388864:12345-192.168.206.55@tcp:256: 20000000:01000000:0.0:1788833024.907911:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788833024.908065:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788833024.908070:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788833024.908073:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788833024.908075:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788833024.912437:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5585:x1875727256388864:12345-192.168.206.55@tcp:256: Request processed in 4537us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833024.912454:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 119 00000100:00100000:2.0:1788833024.918684:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.918823:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256388992 00000100:00100000:3.0:1788833024.918833:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256388992 00000100:00100000:3.0:1788833024.918979:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:3.0:1788833024.918989:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5585:x1875727256388992:12345-192.168.206.55@tcp:101: 00010000:00010000:3.0:1788833024.919014:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833024.919044:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ad65 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.919070:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.919082:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.919091:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833024.919149:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5585:x1875727256388992:12345-192.168.206.55@tcp:101: Request processed in 162us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.919156:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:2.0:1788833024.923705:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833024.923801:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256389120 00000100:00100000:1.0:1788833024.923811:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256389120 00000100:00100000:1.0:1788833024.923971:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 121 00000100:00100000:1.0:1788833024.923982:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5585:x1875727256389120:12345-192.168.206.55@tcp:501: 00000100:00100000:1.0:1788833024.924271:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5585:x1875727256389120:12345-192.168.206.55@tcp:501: Request processed in 289us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.924295:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 121 00000100:00100000:1.0:1788833024.928397:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.928486:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256389248 00000100:00100000:3.0:1788833024.928496:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256389248 00000100:00100000:3.0:1788833024.928544:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 122 00000100:00100000:3.0:1788833024.928553:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5585:x1875727256389248:12345-192.168.206.55@tcp:503: 00000100:00100000:3.0:1788833024.929198:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5585:x1875727256389248:12345-192.168.206.55@tcp:503: Request processed in 643us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.929207:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 122 00000100:00100000:3.0:1788833024.933109:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833024.933516:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256389376 00000100:00100000:2.0:1788833024.933529:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256389376 00000100:00100000:2.0:1788833024.933600:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 123 00000100:00100000:2.0:1788833024.933610:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5606:x1875727256389376:12345-192.168.206.55@tcp:502: 00000100:00100000:2.0:1788833024.935354:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5606:x1875727256389376:12345-192.168.206.55@tcp:502: Request processed in 1735us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.935366:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 123 00000100:00100000:2.0:1788833024.938992:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833024.939581:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256389504 00000100:00100000:3.0:1788833024.939593:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256389504 00000100:00100000:3.0:1788833024.939651:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 124 00000100:00100000:3.0:1788833024.939661:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5606:x1875727256389504:12345-192.168.206.55@tcp:502: 00000100:00100000:3.0:1788833024.940023:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5606:x1875727256389504:12345-192.168.206.55@tcp:502: Request processed in 363us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.940069:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 124 00000100:00100000:1.0:1788833024.948615:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833024.948720:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256389632 00000100:00100000:2.0:1788833024.948730:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256389632 00000100:00100000:2.0:1788833024.948776:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:2.0:1788833024.948783:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1875727256389632:12345-192.168.206.55@tcp:38: 00010000:00080000:2.0:1788833024.948809:0:5811:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1788833024.949326:0:5811:0:(genops.c:1385:class_connect()) connect: client 458534c2-c478-4b32-bcda-93b4ecf625e9, cookie 0x8c08e876ed3fe97e 00000004:00100000:2.0:1788833024.949355:0:5811:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1788833024.949360:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788833025.005822:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788833025.007371:0:5811:0:(import.c:65:import_set_state_nolock()) ffff9cea068ec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788833025.007452:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2356:x1875727256389632:12345-192.168.206.55@tcp:38: Request processed in 58666us (58845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833025.007462:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:0.0:1788833025.645869:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265847552:0@lo:400: 00000100:00100000:0.0:1788833025.645958:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833025.646009:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265848064:0@lo:400: 00000100:00100000:0.0:1788833025.646074:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833025.646098:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788833025.646104:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265847680:0@lo:400: 00000100:00100000:0.0:1788833025.646124:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833025.646138:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265848192:0@lo:400: 00000100:00100000:0.0:1788833025.646160:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833025.646214:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848064 00000100:00100000:0.0:1788833025.646221:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848064 00000100:00100000:0.0:1788833025.646286:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847680 00000100:00100000:0.0:1788833025.646290:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847680 00000100:00100000:3.0:1788833025.646302:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265847808:0@lo:400: 00000100:00100000:0.0:1788833025.646311:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788833025.646321:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265848064:12345-0@lo:400: 00000100:00100000:3.0:1788833025.646345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833025.646364:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788833025.646370:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265847936:0@lo:400: 00000100:00100000:3.0:1788833025.646393:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833025.646425:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848192 00000100:00100000:3.0:1788833025.646429:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848192 00000100:00100000:3.0:1788833025.646466:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847936 00000100:00100000:3.0:1788833025.646470:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847936 00000100:00100000:3.0:1788833025.646485:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788833025.646492:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265848192:12345-0@lo:400: 00000100:00100000:0.0:1788833025.646572:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265848064:12345-0@lo:400: Request processed in 251us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833025.646581:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788833025.646595:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847808 00000100:00100000:0.0:1788833025.646598:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847808 00000100:00100000:0.0:1788833025.646615:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788833025.646622:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265847680:12345-0@lo:400: 00000100:00100000:3.0:1788833025.646646:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265848192:12345-0@lo:400: Request processed in 153us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833025.646655:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833025.646661:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265847680:12345-0@lo:400: Request processed in 39us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833025.646668:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788833025.646674:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788833025.646684:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788833025.646692:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265847936:12345-0@lo:400: 00000100:00100000:0.0:1788833025.646696:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265847808:12345-0@lo:400: 00000100:00100000:0.0:1788833025.646728:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265847808:12345-0@lo:400: Request processed in 37us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833025.646741:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788833025.646758:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788833025.646761:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788833025.646764:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788833025.646789:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea269c9f80 x1875727265847680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833025.646801:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265847680:0@lo:400: 00010000:00080000:0.0:1788833025.646812:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea269c8e00 x1875727265848192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833025.646820:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788833025.646831:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265848192:0@lo:400: 00010000:00080000:0.0:1788833025.646839:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea269cad80 x1875727265848064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833025.646846:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265848064:0@lo:400: 00010000:00080000:2.0:1788833025.646964:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea269c8a80 x1875727265847808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833025.646973:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265847808:0@lo:400: 00000100:00100000:1.0:1788833025.647117:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265847552 00000100:00100000:1.0:1788833025.647122:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265847552 00000100:00100000:1.0:1788833025.647158:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788833025.647165:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265847552:12345-0@lo:400: 00000100:00100000:1.0:1788833025.647218:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265847552:12345-0@lo:400: Request processed in 54us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833025.647226:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788833025.647243:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265847936:12345-0@lo:400: Request processed in 556us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833025.647251:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788833025.647298:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea269ca680 x1875727265847936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833025.647308:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265847936:0@lo:400: 00000100:00100000:0.0:1788833025.647532:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265847552:0@lo:400: 00000100:00100000:2.0:1788833025.768174:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833025.768310:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256389888 00000100:00100000:0.0:1788833025.768321:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256389888 00000100:00100000:0.0:1788833025.768412:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:0.0:1788833025.768423:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5585:x1875727256389888:12345-192.168.206.55@tcp:41: 00000004:00000024:0.0:1788833025.768463:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788833025.768526:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5585:x1875727256389888:12345-192.168.206.55@tcp:41: Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833025.768533:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00080000:1.0:1788833025.768767:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833025.770392:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833025.770673:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256389760 00000100:00100000:2.0:1788833025.770683:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256389760 00000100:00100000:2.0:1788833025.770734:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:2.0:1788833025.770743:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:0:x1875727256389760:12345-192.168.206.55@tcp:41: 00000004:00000024:2.0:1788833025.770767:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788833025.770830:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:0:x1875727256389760:12345-192.168.206.55@tcp:41: Request processed in 89us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833025.770851:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:1.0:1788833025.772665:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833025.772753:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390016 00000100:00100000:0.0:1788833025.772773:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390016 00000100:00100000:0.0:1788833025.772827:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:0.0:1788833025.772836:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5585:x1875727256390016:12345-192.168.206.55@tcp:40: 00000100:00100000:0.0:1788833025.772913:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5585:x1875727256390016:12345-192.168.206.55@tcp:40: Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833025.772920:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:0.0:1788833025.777771:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833025.777819:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833025.777911:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390144 00000100:00100000:2.0:1788833025.777920:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390144 00000100:00100000:2.0:1788833025.777961:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390272 00000100:00100000:2.0:1788833025.777964:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390272 00000100:00100000:2.0:1788833025.777978:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1788833025.777985:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875727256390144:12345-192.168.206.55@tcp:8: 00010000:00080000:2.0:1788833025.778014:0:6654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1788833025.778077:0:6654:0:(genops.c:1385:class_connect()) connect: client 458534c2-c478-4b32-bcda-93b4ecf625e9, cookie 0x8c08e876ed3fe985 00002000:00100000:2.0:1788833025.778088:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 458534c2-c478-4b32-bcda-93b4ecf625e9/ffff9ce901272000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788833025.778110:0:6654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788833025.778687:0:6654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788833025.778720:0:6654:0:(import.c:65:import_set_state_nolock()) ffff9ce901277800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833025.778787:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2356:x1875727256390144:12345-192.168.206.55@tcp:8: Request processed in 801us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833025.778795:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1788833025.778813:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:2.0:1788833025.778818:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875727256390272:12345-192.168.206.55@tcp:8: 00010000:00080000:2.0:1788833025.778835:0:6654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1788833025.778852:0:6654:0:(genops.c:1385:class_connect()) connect: client 458534c2-c478-4b32-bcda-93b4ecf625e9, cookie 0x8c08e876ed3fe98c 00002000:00100000:2.0:1788833025.778857:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 458534c2-c478-4b32-bcda-93b4ecf625e9/ffff9ce901277000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788833025.778871:0:6654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00100000:1.0:1788833025.780552:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00002000:00080000:2.0:1788833025.781453:0:6654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788833025.781490:0:6654:0:(import.c:65:import_set_state_nolock()) ffff9ce901274000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833025.781620:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390400 00000100:00100000:3.0:1788833025.781627:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390400 00000100:00100000:3.0:1788833025.781680:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833025.781696:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5585:x1875727256390400:12345-192.168.206.55@tcp:33: 00000100:00100000:2.0:1788833025.782321:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2356:x1875727256390272:12345-192.168.206.55@tcp:8: Request processed in 3499us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833025.782330:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:0.0:1788833025.799345:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833025.801452:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390528 00000100:00100000:3.0:1788833025.801464:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390528 00000100:00100000:3.0:1788833025.801525:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 126 00000100:00100000:3.0:1788833025.801535:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2358:x1875727256390528:12345-192.168.206.55@tcp:400: 00000100:00100000:3.0:1788833025.801612:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2358:x1875727256390528:12345-192.168.206.55@tcp:400: Request processed in 79us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833025.801620:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 126 00000004:00080000:3.0:1788833025.837367:0:5814:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 55616us 00000004:00200000:3.0:1788833025.878294:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788833025.878404:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5585:x1875727256390400:12345-192.168.206.55@tcp:33: Request processed in 96704us (97853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833025.878414:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00010000:00010000:2.0:1788833026.029250:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833026.110208:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833026.110812:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390656 00000100:00100000:3.0:1788833026.110825:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390656 00000100:00100000:3.0:1788833026.110907:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:3.0:1788833026.110920:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5624:x1875727256390656:12345-192.168.206.55@tcp:101: 00010000:00010000:3.0:1788833026.110944:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833026.112464:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc800/0x8c08e876ed3fe993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ad8f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.112551:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fe99a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.112564:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fe99a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.112599:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fe99a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833026.112638:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788833026.112642:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833026.112656:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fe99a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.112685:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc800/0x8c08e876ed3fe993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad8f expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.112707:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fe99a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad8f expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.112714:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:3.0:1788833026.112717:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833026.112721:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dc600, rc 0) 00000100:00100000:3.0:1788833026.112877:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:5624:x1875727256390656:12345-192.168.206.55@tcp:101: Request processed in 1958us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833026.112887:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:1.0:1788833026.158405:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833026.159441:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265848448:0@lo:13: 00000100:00100000:1.0:1788833026.159507:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833026.159571:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265848320:0@lo:13: 00000100:00100000:1.0:1788833026.159594:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833026.162281:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848448 00000100:00100000:2.0:1788833026.162295:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848448 00000100:00100000:2.0:1788833026.162342:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848320 00000100:00100000:2.0:1788833026.162345:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848320 00000100:00100000:2.0:1788833026.162363:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833026.162373:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265848448:12345-0@lo:13: 00002000:00000024:2.0:1788833026.162404:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833026.162495:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265848448:12345-0@lo:13: Request processed in 123us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833026.162502:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833026.162519:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833026.162525:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265848320:12345-0@lo:13: 00002000:00000024:2.0:1788833026.162535:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833026.162565:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265848320:12345-0@lo:13: Request processed in 40us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833026.162570:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788833026.165385:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb66300 x1875727265848448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833026.165412:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265848448:0@lo:13: 00010000:00080000:1.0:1788833026.165426:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea06749500 x1875727265848320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833026.165459:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265848320:0@lo:13: 00010000:00010000:1.0:1788833027.053932:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833028.077235:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833028.297851:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833028.297985:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390784 00000100:00100000:2.0:1788833028.298001:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390784 00000100:00100000:2.0:1788833028.298153:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:2.0:1788833028.298167:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:5676:x1875727256390784:12345-192.168.206.55@tcp:41: 00000004:00000024:2.0:1788833028.298209:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788833028.298296:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:5676:x1875727256390784:12345-192.168.206.55@tcp:41: Request processed in 133us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833028.298317:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00080000:1.0:1788833028.298372:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833028.303970:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833028.304093:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256390912 00000100:00100000:0.0:1788833028.304115:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256390912 00000100:00100000:0.0:1788833028.304217:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:0.0:1788833028.304230:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5676:x1875727256390912:12345-192.168.206.55@tcp:13: 00002000:00000024:0.0:1788833028.304288:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833028.304379:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5676:x1875727256390912:12345-192.168.206.55@tcp:13: Request processed in 152us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833028.304387:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00080000:1.0:1788833028.304724:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833028.307581:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833028.307772:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391040 00000100:00100000:2.0:1788833028.307785:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391040 00000100:00100000:2.0:1788833028.307867:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1788833028.307879:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5676:x1875727256391040:12345-192.168.206.55@tcp:13: 00002000:00000024:2.0:1788833028.307927:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833028.308017:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458534c2-c478-4b32-bcda-93b4ecf625e9+6:5676:x1875727256391040:12345-192.168.206.55@tcp:13: Request processed in 139us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833028.308025:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00080000:1.0:1788833028.308702:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788833028.750770:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00010000:00010000:1.0:1788833029.102023:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833030.125509:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788833030.338217:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000001:00100000:3.0:1788833030.369889:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000100:00100000:1.0:1788833030.766316:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265848576:0@lo:400: 00000100:00100000:1.0:1788833030.766418:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833030.767191:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265848960:0@lo:400: 00000100:00100000:0.0:1788833030.767259:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833030.767298:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848960 00000100:00100000:0.0:1788833030.767331:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788833030.767338:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265848832:0@lo:400: 00000100:00100000:0.0:1788833030.767366:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833030.767394:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848832 00000100:00100000:0.0:1788833030.767401:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848832 00000100:00100000:0.0:1788833030.767472:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788833030.767482:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265848832:12345-0@lo:400: 00000100:00100000:3.0:1788833030.767536:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848960 00000100:00100000:0.0:1788833030.767536:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265848832:12345-0@lo:400: Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833030.767547:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788833030.767589:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788833030.767600:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265848960:12345-0@lo:400: 00000100:00100000:0.0:1788833030.767609:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265848832:0@lo:400: 00010000:00080000:0.0:1788833030.767666:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea396c1180 x1875727265848960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833030.767677:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265848960:0@lo:400: 00000100:00080000:0.0:1788833030.767700:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788833030.767705:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833030.767729:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265848960:12345-0@lo:400: Request processed in 60us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833030.767744:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833030.767968:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265848704:0@lo:400: 00000100:00100000:2.0:1788833030.768007:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833030.768054:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848704 00000100:00100000:2.0:1788833030.768056:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265849216:0@lo:400: 00000100:00100000:3.0:1788833030.768059:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848704 00000100:00100000:2.0:1788833030.768084:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833030.768141:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265848576 00000100:00100000:2.0:1788833030.768145:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265848576 00000100:00100000:2.0:1788833030.768184:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788833030.768214:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788833030.768223:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265848704:12345-0@lo:400: 00000100:00100000:3.0:1788833030.768285:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265848704:12345-0@lo:400: Request processed in 63us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833030.768292:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788833030.768413:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265848704:0@lo:400: 00000100:00100000:0.0:1788833030.769320:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265849088:0@lo:400: 00000100:00100000:0.0:1788833030.769375:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833030.769591:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265849088 00000100:00100000:1.0:1788833030.769598:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265849088 00000100:00100000:1.0:1788833030.769667:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788833030.769676:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265849088:12345-0@lo:400: 00000100:00100000:1.0:1788833030.769732:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265849088:12345-0@lo:400: Request processed in 57us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833030.769740:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788833030.769783:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833030.769785:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265849088:0@lo:400: 00000100:00100000:0.0:1788833030.770123:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265849216 00000100:00100000:0.0:1788833030.770129:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265849216 00000100:00100000:0.0:1788833030.770178:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788833030.770187:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265849216:12345-0@lo:400: 00000100:00100000:0.0:1788833030.770241:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265849216:12345-0@lo:400: Request processed in 56us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833030.770260:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788833030.770298:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea396c1880 x1875727265849216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833030.770311:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265849216:0@lo:400: 00000100:00080000:1.0:1788833030.772321:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833030.773535:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265848576:12345-0@lo:400: 00000100:00100000:2.0:1788833030.773674:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265848576:12345-0@lo:400: Request processed in 5481us (7255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833030.773685:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788833030.773773:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265848576:0@lo:400: 00000100:00100000:3.0:1788833030.869391:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833030.869430:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833030.869470:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833030.869500:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833030.869540:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391424 00000100:00100000:3.0:1788833030.869553:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391424 00000100:00100000:3.0:1788833030.869626:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391552 00000100:00100000:3.0:1788833030.869629:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391552 00000100:00100000:3.0:1788833030.869653:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:1.0:1788833030.869945:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391168 00000100:00100000:1.0:1788833030.869950:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391168 00000100:00100000:1.0:1788833030.869984:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00100000:1.0:1788833030.869996:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2359:x1875727256391168:12345-192.168.206.55@tcp:400: 00000100:00100000:1.0:1788833030.870363:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2359:x1875727256391168:12345-192.168.206.55@tcp:400: Request processed in 367us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833030.870371:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00100000:0.0:1788833030.870492:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391296 00000100:00100000:0.0:1788833030.870497:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391296 00000100:00100000:0.0:1788833030.870545:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:0.0:1788833030.870553:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256391296:12345-192.168.206.55@tcp:400: 00000100:00100000:0.0:1788833030.870591:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256391296:12345-192.168.206.55@tcp:400: Request processed in 40us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833030.870598:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1788833030.870768:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256391424:12345-192.168.206.55@tcp:400: 00000100:00100000:3.0:1788833030.870802:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256391424:12345-192.168.206.55@tcp:400: Request processed in 39us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833030.870809:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1788833030.870826:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:3.0:1788833030.870834:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256391552:12345-192.168.206.55@tcp:400: 00000100:00100000:3.0:1788833030.870858:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256391552:12345-192.168.206.55@tcp:400: Request processed in 26us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833030.870864:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00080000:3.0:1788833030.870896:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788833030.870901:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833030.870904:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788833030.955437:0:8261:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788833031.149278:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833031.277406:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833031.277446:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265849344:0@lo:13: 00000100:00100000:1.0:1788833031.277562:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833031.277809:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265849344 00000100:00100000:3.0:1788833031.277820:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265849344 00000100:00100000:3.0:1788833031.277889:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788833031.277901:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265849344:12345-0@lo:13: 00002000:00000024:3.0:1788833031.277959:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833031.278068:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265849344:12345-0@lo:13: Request processed in 169us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833031.278077:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788833031.278168:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea06748a80 x1875727265849344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833031.278192:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265849344:0@lo:13: 00000100:00100000:2.0:1788833031.278579:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833031.278595:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265849472:0@lo:13: 00000100:00100000:2.0:1788833031.278659:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833031.278835:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265849472 00000100:00100000:3.0:1788833031.278841:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265849472 00000100:00100000:3.0:1788833031.278880:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788833031.278888:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265849472:12345-0@lo:13: 00002000:00000024:3.0:1788833031.278929:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833031.278990:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265849472:12345-0@lo:13: Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833031.278997:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788833031.279215:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb65f80 x1875727265849472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833031.279234:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265849472:0@lo:13: 00010000:00010000:2.0:1788833032.175637:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833033.198912:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833034.223109:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788833034.434595:0:8408:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff8151660 20000000:00000080:1.0:1788833034.434612:0:8408:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cea3f5ff800 uarg=0000000000000000 20000000:01000000:1.0:1788833034.434648:0:8408:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788833034.434651:0:8408:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788833034.434654:0:8408:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788833034.434658:0:8408:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788833034.434663:0:8408:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788833034.434677:0:8408:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788833034.434680:0:8408:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788833034.434873:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788833034.434876:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788833034.436553:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788833034.437554:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788833034.437642:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788833034.437684:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788833034.437699:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788833034.437701:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788833034.438626:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788833034.439698:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788833034.439758:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788833034.439797:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788833034.439814:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788833034.439817:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788833034.441493:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788833034.441933:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788833034.441981:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788833034.444210:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788833034.444406:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788833034.444409:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788833034.445767:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788833034.446358:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788833034.446420:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788833034.446454:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1788833034.446469:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788833034.446487:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446503:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446510:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446516:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446523:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446529:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446535:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446541:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446549:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446556:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446571:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446606:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446620:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 9 pid: 5806 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.446634:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849600:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833034.446783:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446792:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 9 pid: 5804 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.446801:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849728:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833034.446850:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446859:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 18 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.446869:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849856:0@lo:104: 00000100:00100000:3.0:1788833034.446908:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833034.446945:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.446963:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 18 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.446971:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849984:0@lo:104: 00000100:00100000:3.0:1788833034.446998:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833034.447022:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.447051:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 18 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.447060:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850112:0@lo:104: 00010000:00010000:3.0:1788833034.447306:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.447314:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 18 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.447383:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850240:0@lo:104: 00010000:00010000:3.0:1788833034.447414:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.447422:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 18 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.447430:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850368:0@lo:104: 00010000:00010000:3.0:1788833034.447453:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.447472:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 18 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.447481:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850496:0@lo:104: 00010000:00010000:3.0:1788833034.447509:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.447516:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 18 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.447524:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850624:0@lo:104: 00000100:00100000:3.0:1788833034.447540:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833034.447635:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788833034.447665:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.447695:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.447704:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.447711:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.447719:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.447728:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265849856 00000100:00100000:2.0:1788833034.447734:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265849856 00000100:00100000:2.0:1788833034.447771:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265849984 00000100:00100000:2.0:1788833034.447774:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265849984 00000100:00100000:2.0:1788833034.447784:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265850112 00000100:00100000:2.0:1788833034.447787:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265850112 00000100:00100000:2.0:1788833034.447796:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265850240 00000100:00100000:2.0:1788833034.447798:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265850240 00000100:00100000:2.0:1788833034.447806:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265850368 00000100:00100000:2.0:1788833034.447809:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265850368 00000100:00100000:2.0:1788833034.447816:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265850496 00000100:00100000:2.0:1788833034.447818:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265850496 00000100:00100000:2.0:1788833034.447826:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265850624 00000100:00100000:2.0:1788833034.447828:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265850624 00000100:00100000:2.0:1788833034.447839:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833034.447846:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:8408:x1875727265849856:12345-0@lo:104: 00010000:00010000:2.0:1788833034.447858:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.447910:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833034.447916:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+9:8408:x1875727265849856:12345-0@lo:104: Request processed in 70us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.447932:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833034.447949:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788833034.447955:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3959c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+8:8408:x1875727265849984:12345-0@lo:104: 00010000:00010000:2.0:1788833034.447964:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.447996:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788833034.448001:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3959c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+8:8408:x1875727265849984:12345-0@lo:104: Request processed in 47us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.448007:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788833034.448056:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788833034.448063:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+7:8408:x1875727265850112:12345-0@lo:104: 00010000:00010000:2.0:1788833034.448082:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448109:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788833034.448114:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+7:8408:x1875727265850112:12345-0@lo:104: Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.448119:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788833034.448130:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788833034.448136:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+6:8408:x1875727265850240:12345-0@lo:104: 00010000:00010000:2.0:1788833034.448143:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448167:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788833034.448171:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+6:8408:x1875727265850240:12345-0@lo:104: Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.448182:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788833034.448194:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788833034.448199:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:8408:x1875727265850368:12345-0@lo:104: 00010000:00010000:2.0:1788833034.448205:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448250:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788833034.448255:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:8408:x1875727265850368:12345-0@lo:104: Request processed in 57us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.448260:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788833034.448271:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788833034.448276:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:8408:x1875727265850496:12345-0@lo:104: 00010000:00010000:2.0:1788833034.448283:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448304:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788833034.448308:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:8408:x1875727265850496:12345-0@lo:104: Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.448313:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788833034.448323:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788833034.448539:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:8408:x1875727265850624:12345-0@lo:104: 00010000:00010000:2.0:1788833034.448548:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448579:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788833034.448583:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:8408:x1875727265850624:12345-0@lo:104: Request processed in 255us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.448595:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788833034.448619:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788833034.448624:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448631:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517000 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833034.448635:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448644:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833034.448650:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833034.448656:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833034.448688:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448694:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833034.448711:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448717:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe94d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe954 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448730:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788833034.448734:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448751:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476400 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833034.448754:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448760:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833034.448765:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833034.448770:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833034.448783:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448788:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833034.448792:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448798:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476400/0x8c08e876ed3fe923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe92a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448808:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788833034.448810:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448816:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932e400 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833034.448818:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448833:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833034.448839:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833034.448844:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833034.448856:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448862:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833034.448879:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448885:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe90e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448894:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788833034.448896:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448902:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477200 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833034.448904:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448911:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833034.448917:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833034.448930:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833034.448943:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448948:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833034.448953:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448959:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32477200/0x8c08e876ed3fe8f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe900 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448968:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788833034.448971:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448976:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476a00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833034.448979:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.448985:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833034.448990:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833034.448995:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833034.449007:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449013:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833034.449024:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449052:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476a00/0x8c08e876ed3fe8eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449061:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833034.449064:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.449203:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849856:0@lo:104: 00000100:00100000:3.0:1788833034.449565:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849984:0@lo:104: 00000100:00100000:3.0:1788833034.449580:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850112:0@lo:104: 00000100:00100000:3.0:1788833034.449587:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850240:0@lo:104: 00000100:00100000:3.0:1788833034.449594:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850368:0@lo:104: 00000100:00100000:3.0:1788833034.449601:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850496:0@lo:104: 00000100:00100000:3.0:1788833034.449607:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265850624:0@lo:104: 00010000:00010000:2.0:1788833034.449733:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476600 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833034.449737:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449745:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833034.449751:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833034.449756:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833034.449773:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449778:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833034.449783:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449790:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3fe8c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8c8 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449800:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833034.449811:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449816:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477a00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833034.449819:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449825:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833034.449830:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833034.449835:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833034.449848:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449854:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833034.449858:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449864:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fe897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe89e expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.449876:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833034.449878:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833034.449879:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833034.449903:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265850752:0@lo:103: 00000100:00100000:2.0:1788833034.449948:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.449986:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265851264:0@lo:103: 00000100:00100000:2.0:1788833034.450019:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.450067:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788833034.450144:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265850880:0@lo:103: 00000100:00100000:2.0:1788833034.450166:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833034.450317:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265850752 00000100:00100000:3.0:1788833034.450323:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265850752 00010000:00010000:3.0:1788833034.450420:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 19 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.450449:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851264 00000100:00100000:3.0:1788833034.450452:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851264 00010000:00010000:3.0:1788833034.450469:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 20 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833034.450483:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788833034.450489:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+20:3276:x1875727265850752:12345-0@lo:103: 00010000:00010000:3.0:1788833034.450500:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833034.450504:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 20 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.450512:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 20 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.450526:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fe954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe94d expref: 20 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.450539:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833034.450569:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265850752:12345-0@lo:103: Request processed in 80us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833034.450575:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788833034.450590:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788833034.450596:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:3276:x1875727265851264:12345-0@lo:103: 00010000:00010000:3.0:1788833034.450604:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833034.450608:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 18 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.450616:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 18 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.450625:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe8f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe8eb expref: 18 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.450644:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833034.450668:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3276:x1875727265851264:12345-0@lo:103: Request processed in 72us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833034.450674:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788833034.450737:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265851392:0@lo:103: 00000100:00100000:2.0:1788833034.450758:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.450776:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265850752:0@lo:103: 00000100:00100000:2.0:1788833034.450782:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265851264:0@lo:103: 00000100:00100000:2.0:1788833034.450807:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851136:0@lo:103: 00000100:00100000:2.0:1788833034.450827:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.450839:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788833034.450843:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851008:0@lo:103: 00000100:00100000:2.0:1788833034.450860:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.450870:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851520:0@lo:103: 00000100:00100000:2.0:1788833034.450888:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833034.450906:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265850880 00000100:00100000:2.0:1788833034.450909:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265850880 00010000:00010000:2.0:1788833034.450925:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 17 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833034.450938:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851392 00000100:00100000:2.0:1788833034.450940:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851392 00010000:00010000:2.0:1788833034.450949:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 18 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833034.450958:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851136 00000100:00100000:2.0:1788833034.450960:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851136 00010000:00010000:2.0:1788833034.450977:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 19 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833034.450988:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851008 00000100:00100000:2.0:1788833034.450990:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851008 00010000:00010000:2.0:1788833034.450999:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 20 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833034.451009:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851520 00000100:00100000:2.0:1788833034.451011:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851520 00010000:00010000:2.0:1788833034.451019:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 21 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833034.451052:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788833034.451059:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+21:3276:x1875727265850880:12345-0@lo:103: 00010000:00010000:2.0:1788833034.451068:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788833034.451465:0:5799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788833034.451473:0:5799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788833034.451689:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788833034.451699:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788833034.451707:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+21:3276:x1875727265851392:12345-0@lo:103: 00010000:00010000:0.0:1788833034.451716:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833034.451721:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 21 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.451731:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 21 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.451744:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fe8c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe8c1 expref: 21 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.451754:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833034.451933:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 20 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.451943:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 20 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.451952:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe92a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe923 expref: 20 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.451960:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833034.452019:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265851392:12345-0@lo:103: Request processed in 312us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833034.452063:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788833034.452092:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788833034.452100:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788833034.452106:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:3279:x1875727265851136:12345-0@lo:103: 00010000:00010000:0.0:1788833034.452114:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833034.452119:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 18 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452127:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 18 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452138:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe8f9 expref: 18 pid: 5804 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452146:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833034.452188:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3279:x1875727265851136:12345-0@lo:103: Request processed in 82us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833034.452194:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788833034.452205:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788833034.452212:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788833034.452237:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3279:x1875727265851008:12345-0@lo:103: 00010000:00010000:0.0:1788833034.452245:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833034.452250:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 16 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452258:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 16 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452268:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32476800/0x8c08e876ed3fe90e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe907 expref: 16 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452282:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833034.452306:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:3279:x1875727265851008:12345-0@lo:103: Request processed in 78us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833034.452312:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788833034.452323:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788833034.452341:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788833034.452348:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3279:x1875727265851520:12345-0@lo:103: 00010000:00010000:0.0:1788833034.452356:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833034.452361:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 14 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452369:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 14 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452378:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3fe89e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe897 expref: 14 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833034.452385:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833034.452406:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:3279:x1875727265851520:12345-0@lo:103: Request processed in 59us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833034.452412:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788833034.452430:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833034.452605:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3276:x1875727265850880:12345-0@lo:103: Request processed in 1546us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.452612:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788833034.455858:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851008:0@lo:103: 00000100:00100000:1.0:1788833034.455874:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851520:0@lo:103: 00000100:00100000:1.0:1788833034.455882:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851136:0@lo:103: 00000100:00100000:3.0:1788833034.456893:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265851392:0@lo:103: 00000100:00100000:3.0:1788833034.456916:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265850880:0@lo:103: 00000100:00100000:2.0:1788833034.457133:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833034.457249:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849600:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833034.457258:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875727265849728:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833034.457294:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833034.457780:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391680 00000100:00100000:1.0:1788833034.457788:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391680 00010000:00010000:1.0:1788833034.457822:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 10 pid: 5806 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833034.457858:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:1.0:1788833034.457867:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2357:x1875727256391680:12345-192.168.206.55@tcp:103: 00010000:00010000:1.0:1788833034.457880:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833034.457886:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 10 pid: 5806 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.457896:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 10 pid: 5806 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.457914:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fe969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad34 expref: 10 pid: 5806 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.457930:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833034.457986:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:2357:x1875727256391680:12345-192.168.206.55@tcp:103: Request processed in 119us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833034.457993:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:3.0:1788833034.458723:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833034.459090:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391808 00000100:00100000:1.0:1788833034.459096:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391808 00010000:00010000:1.0:1788833034.459121:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 9 pid: 5804 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833034.459150:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:1.0:1788833034.459157:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:2360:x1875727256391808:12345-192.168.206.55@tcp:103: 00010000:00010000:1.0:1788833034.459189:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833034.459195:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 9 pid: 5804 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459207:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 9 pid: 5804 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459732:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fe962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad2d expref: 9 pid: 5804 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459750:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459757:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459773:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459780:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459786:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459792:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459797:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833034.459801:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459818:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459831:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833034.459841:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833034.459883:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:2360:x1875727256391808:12345-192.168.206.55@tcp:103: Request processed in 727us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833034.459890:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00010000:00010000:3.0:1788833034.460169:0:8408:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.460177:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833034.460183:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dc800/0x8c08e876ed3fe9a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833035.245419:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833035.885318:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265851904:0@lo:400: 00000100:00100000:0.0:1788833035.885384:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833035.885445:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788833035.885451:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265851776:0@lo:400: 00000100:00100000:0.0:1788833035.885474:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833035.885505:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265852288:0@lo:400: 00000100:00100000:0.0:1788833035.885530:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833035.885578:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851904 00000100:00100000:0.0:1788833035.885585:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851904 00000100:00100000:0.0:1788833035.885630:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851776 00000100:00100000:0.0:1788833035.885633:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851776 00000100:00100000:0.0:1788833035.885649:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788833035.885657:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265851904:12345-0@lo:400: 00000100:00100000:0.0:1788833035.885704:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265851904:12345-0@lo:400: Request processed in 48us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833035.885711:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788833035.885728:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788833035.885734:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265851776:12345-0@lo:400: 00000100:00100000:0.0:1788833035.885760:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265851776:12345-0@lo:400: Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833035.885766:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788833035.885800:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265851776:0@lo:400: 00000100:00100000:0.0:1788833035.885810:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265851904:0@lo:400: 00000100:00100000:1.0:1788833035.886012:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851648:0@lo:400: 00000100:00100000:1.0:1788833035.886084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833035.886108:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265852160:0@lo:400: 00000100:00100000:1.0:1788833035.886130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833035.886149:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833035.886155:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265852032:0@lo:400: 00000100:00100000:1.0:1788833035.886177:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833035.886200:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852160 00000100:00100000:1.0:1788833035.886204:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852160 00000100:00100000:1.0:1788833035.886239:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788833035.886247:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265852160:12345-0@lo:400: 00000100:00100000:3.0:1788833035.886299:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852288 00000100:00100000:1.0:1788833035.886304:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265852160:12345-0@lo:400: Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833035.886306:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852288 00000100:00100000:1.0:1788833035.886314:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788833035.886344:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852032 00000100:00100000:3.0:1788833035.886349:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852032 00000100:00100000:1.0:1788833035.886352:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265852160:0@lo:400: 00000100:00100000:3.0:1788833035.886382:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788833035.886390:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265852288:12345-0@lo:400: 00000100:00100000:1.0:1788833035.886396:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788833035.886411:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788833035.886428:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833035.886440:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265852288:12345-0@lo:400: Request processed in 52us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833035.886448:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788833035.886448:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833035.886455:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833035.886467:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788833035.886475:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265852032:12345-0@lo:400: 00000100:00100000:3.0:1788833035.886510:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265852032:12345-0@lo:400: Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833035.886516:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788833035.886614:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb67100 x1875727265852288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833035.886626:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265852288:0@lo:400: 00010000:00080000:1.0:1788833035.886661:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb65880 x1875727265852032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833035.886672:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265852032:0@lo:400: 00000100:00100000:0.0:1788833035.887370:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265851648 00000100:00100000:0.0:1788833035.887378:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265851648 00000100:00100000:0.0:1788833035.887420:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788833035.887429:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3279:x1875727265851648:12345-0@lo:400: 00000100:00100000:0.0:1788833035.887494:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:3279:x1875727265851648:12345-0@lo:400: Request processed in 66us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833035.887501:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788833035.887638:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265851648:0@lo:400: 00000100:00100000:3.0:1788833035.980537:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833035.980639:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833035.980685:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833035.980722:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833035.980753:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392320 00000100:00100000:3.0:1788833035.980762:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392320 00000100:00100000:3.0:1788833035.980817:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392192 00000100:00100000:3.0:1788833035.980821:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392192 00000100:00100000:3.0:1788833035.980845:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1788833035.980854:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256392320:12345-192.168.206.55@tcp:400: 00000100:00100000:3.0:1788833035.980922:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256392320:12345-192.168.206.55@tcp:400: Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833035.980930:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1788833035.980959:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:3.0:1788833035.980965:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256392192:12345-192.168.206.55@tcp:400: 00000100:00100000:3.0:1788833035.980990:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256392192:12345-192.168.206.55@tcp:400: Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833035.980996:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00080000:0.0:1788833035.981177:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788833035.981186:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833035.981280:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256391936 00000100:00100000:2.0:1788833035.981285:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256391936 00000100:00100000:2.0:1788833035.981320:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 130 00000100:00100000:2.0:1788833035.981327:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:2357:x1875727256391936:12345-192.168.206.55@tcp:400: 00000100:00100000:2.0:1788833035.981354:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:2357:x1875727256391936:12345-192.168.206.55@tcp:400: Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833035.981361:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 130 00000100:00100000:1.0:1788833035.982880:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392064 00000100:00100000:1.0:1788833035.982891:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392064 00000100:00100000:1.0:1788833035.983005:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:1.0:1788833035.983029:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256392064:12345-192.168.206.55@tcp:400: 00000100:00100000:1.0:1788833035.983430:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256392064:12345-192.168.206.55@tcp:400: Request processed in 416us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833035.983440:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00080000:0.0:1788833035.985161:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1788833036.206655:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788833036.206663:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea06626000 from 39 10000000:01000000:2.0:1788833036.206668:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788833036.206717:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.206729:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.206741:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833036.206764:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265852416:0@lo:101: 00000100:00100000:2.0:1788833036.206828:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.206958:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833036.211245:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852416 00000100:00100000:1.0:1788833036.211258:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852416 00000100:00100000:1.0:1788833036.211365:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788833036.211375:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+12:5809:x1875727265852416:12345-0@lo:101: 00010000:00010000:1.0:1788833036.211389:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833036.211406:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932ec00/0x8c08e876ed3fe9af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe9a8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.211430:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932ec00/0x8c08e876ed3fe9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9a8 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.211440:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932ec00/0x8c08e876ed3fe9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9a8 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.211449:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932ec00, rc 0) 00000100:00100000:1.0:1788833036.211536:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265852416:12345-0@lo:101: Request processed in 164us (4708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.211543:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788833036.211618:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265852416:0@lo:101: 00010000:00010000:3.0:1788833036.211634:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.211643:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833036.211702:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265852544:0@lo:501: 00000100:00100000:3.0:1788833036.211729:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.216402:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852544 00000100:00100000:2.0:1788833036.216418:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852544 00000100:00100000:3.0:1788833036.216447:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.216474:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788833036.216485:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265852544:12345-0@lo:501: 00000100:00100000:2.0:1788833036.217491:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265852544:12345-0@lo:501: Request processed in 1005us (5757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.217507:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788833036.217889:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265852544:0@lo:501: 00000100:00100000:3.0:1788833036.217939:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265852672:0@lo:503: 00000100:00100000:3.0:1788833036.217986:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.218113:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.218624:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852672 00000100:00100000:0.0:1788833036.218632:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852672 00000100:00100000:0.0:1788833036.218970:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788833036.218980:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265852672:12345-0@lo:503: 00000100:00100000:3.0:1788833036.219269:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265852672:0@lo:503: 00000100:00100000:0.0:1788833036.219270:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265852672:12345-0@lo:503: Request processed in 291us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.219277:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788833036.219767:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8427:1875727265852800:0@lo:502: 00000100:00100000:3.0:1788833036.219812:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.219855:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.219913:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852800 00000100:00100000:2.0:1788833036.219919:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852800 00000100:00100000:2.0:1788833036.220007:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788833036.220016:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:8427:x1875727265852800:12345-0@lo:502: 00000100:00100000:2.0:1788833036.220433:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:8427:x1875727265852800:12345-0@lo:502: Request processed in 418us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.220435:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8427:1875727265852800:0@lo:502: 00000100:00100000:2.0:1788833036.220442:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788833036.220480:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8427:1875727265852928:0@lo:502: 00000100:00100000:3.0:1788833036.220531:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.220560:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.220734:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265852928 00000100:00100000:0.0:1788833036.220739:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265852928 00000100:00100000:0.0:1788833036.220812:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788833036.220820:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:8427:x1875727265852928:12345-0@lo:502: 00000100:00100000:0.0:1788833036.220999:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:8427:x1875727265852928:12345-0@lo:502: Request processed in 179us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.221006:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788833036.221089:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8427:1875727265852928:0@lo:502: 00000040:00080000:3.0:1788833036.221113:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788833036.221340:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788833036.221360:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788833036.221370:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.221382:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833036.221391:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788833036.221395:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788833036.221398:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788833036.221432:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.221443:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.221452:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833036.221465:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853056:0@lo:101: 00000100:00100000:2.0:1788833036.221507:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.221569:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538480 going to sleep for 11 seconds 00000100:00100000:3.0:1788833036.221872:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853056 00000100:00100000:3.0:1788833036.221878:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853056 00000100:00100000:3.0:1788833036.221962:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788833036.221971:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+13:5809:x1875727265853056:12345-0@lo:101: 00010000:00010000:3.0:1788833036.221981:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833036.221993:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dc000/0x8c08e876ed3fe9bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe9b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.222015:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dc000/0x8c08e876ed3fe9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9b6 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.222026:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dc000/0x8c08e876ed3fe9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9b6 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.222076:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dc000, rc 0) 00000100:00100000:3.0:1788833036.222122:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265853056:12345-0@lo:101: Request processed in 153us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.222128:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788833036.222322:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853056:0@lo:101: 00010000:00010000:2.0:1788833036.222334:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.222342:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833036.222390:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853184:0@lo:501: 00000100:00100000:2.0:1788833036.222417:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.222487:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538480 going to sleep for 11 seconds 00000100:00100000:3.0:1788833036.222522:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853184 00000100:00100000:3.0:1788833036.222526:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853184 00000100:00100000:3.0:1788833036.222552:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788833036.222559:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265853184:12345-0@lo:501: 00000100:00100000:3.0:1788833036.222802:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265853184:12345-0@lo:501: Request processed in 243us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.222819:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788833036.222890:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853184:0@lo:501: 00000100:00100000:2.0:1788833036.222915:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853312:0@lo:503: 00000100:00100000:2.0:1788833036.222950:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.222970:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538480 going to sleep for 11 seconds 00000100:00100000:3.0:1788833036.223009:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853312 00000100:00100000:3.0:1788833036.223013:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853312 00000100:00100000:3.0:1788833036.223065:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788833036.223072:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265853312:12345-0@lo:503: 00000100:00100000:3.0:1788833036.223194:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265853312:12345-0@lo:503: Request processed in 122us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.223201:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788833036.223281:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853312:0@lo:503: 00000100:00100000:2.0:1788833036.223565:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8428:1875727265853440:0@lo:502: 00000100:00100000:2.0:1788833036.223600:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.223627:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538780 going to sleep for 11 seconds 00000100:00100000:3.0:1788833036.223667:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853440 00000100:00100000:3.0:1788833036.223672:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853440 00000100:00100000:3.0:1788833036.223691:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788833036.223697:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:8428:x1875727265853440:12345-0@lo:502: 00000100:00100000:3.0:1788833036.223838:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:8428:x1875727265853440:12345-0@lo:502: Request processed in 140us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.223845:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788833036.223918:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8428:1875727265853440:0@lo:502: 00000020:01000000:2.0:1788833036.223944:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833036.223951:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833036.223954:0:8428:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788833036.223958:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788833036.223979:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8428:1875727265853568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833036.224021:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.224067:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538780 going to sleep for 11 seconds 00000100:00100000:3.0:1788833036.224140:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853568 00000100:00100000:3.0:1788833036.224145:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853568 00000100:00100000:3.0:1788833036.224162:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788833036.224168:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:8428:x1875727265853568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.224295:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:8428:x1875727265853568:12345-0@lo:502:llog_process_th.0 Request processed in 126us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.224302:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788833036.224384:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8428:1875727265853568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833036.224403:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833036.224408:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833036.224409:0:8428:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788833036.224413:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788833036.224636:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788833036.224654:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788833036.224662:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.224684:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833036.224693:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788833036.224696:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea1fc5c800 from 39 10000000:01000000:3.0:1788833036.224699:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788833036.224721:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.224729:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.224737:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833036.224750:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.224779:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.224809:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833036.224868:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853696 00000100:00100000:1.0:1788833036.224872:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853696 00000100:00100000:1.0:1788833036.224894:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788833036.224901:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:5809:x1875727265853696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833036.224910:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833036.224922:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe9cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe9c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.224942:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9c4 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.224952:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9c4 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.224959:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e800, rc 0) 00000100:00100000:1.0:1788833036.224998:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265853696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.225004:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788833036.225307:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833036.225321:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.225329:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833036.225373:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.225399:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.225422:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833036.225470:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853824 00000100:00100000:1.0:1788833036.225475:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853824 00000100:00100000:1.0:1788833036.225501:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788833036.225507:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265853824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.225847:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265853824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.225855:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788833036.226014:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.226218:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.226268:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.226327:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.226358:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265853952 00000100:00100000:2.0:1788833036.226362:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265853952 00000100:00100000:2.0:1788833036.226430:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788833036.226438:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265853952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833036.226588:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265853952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.226594:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788833036.226664:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265853952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.226984:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8429:1875727265854080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.227023:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.227520:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03393600 going to sleep for 11 seconds 00000100:00100000:1.0:1788833036.227911:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854080 00000100:00100000:1.0:1788833036.227919:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854080 00000100:00100000:1.0:1788833036.227953:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788833036.227962:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:8429:x1875727265854080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833036.228246:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:8429:x1875727265854080:12345-0@lo:502:llog_process_th.0 Request processed in 285us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.228253:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788833036.229343:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8429:1875727265854080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.229417:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8429:1875727265854208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.229477:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.229511:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.229587:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854208 00000100:00100000:2.0:1788833036.229594:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854208 00000100:00100000:2.0:1788833036.229639:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788833036.229647:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:8429:x1875727265854208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833036.229857:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:8429:x1875727265854208:12345-0@lo:502:llog_process_th.0 Request processed in 210us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.229865:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788833036.230084:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8429:1875727265854208:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788833036.230112:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788833036.230362:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788833036.230381:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788833036.230390:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.230400:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833036.230409:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788833036.230412:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788833036.230414:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788833036.230440:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.230460:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.230470:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833036.230484:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833036.230518:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833036.230547:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c74e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.230593:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854336 00000100:00100000:2.0:1788833036.230975:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854336 00000100:00100000:2.0:1788833036.231111:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788833036.231121:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:5809:x1875727265854336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833036.231132:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833036.231151:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517800/0x8c08e876ed3fe9d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe9d2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.231175:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517800/0x8c08e876ed3fe9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9d2 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.231185:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517800/0x8c08e876ed3fe9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9d2 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.231193:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517800, rc 0) 00000100:00100000:2.0:1788833036.231424:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265854336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 305us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.231431:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788833036.231493:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833036.231509:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.231517:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833036.231576:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833036.231614:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833036.231945:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c74e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833036.232014:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854464 00000100:00100000:1.0:1788833036.232020:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854464 00000100:00100000:1.0:1788833036.232370:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788833036.232379:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265854464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.232864:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265854464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 486us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.232872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788833036.233518:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.233563:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.233826:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.233915:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03393600 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.233961:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854592 00000100:00100000:2.0:1788833036.233967:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854592 00000100:00100000:2.0:1788833036.234117:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788833036.234126:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265854592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833036.234499:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265854592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 373us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.234506:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788833036.234576:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.238556:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8430:1875727265854720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833036.238882:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833036.239018:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.239182:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854720 00000100:00100000:0.0:1788833036.239190:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854720 00000100:00100000:0.0:1788833036.239359:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788833036.239369:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8430:x1875727265854720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833036.239607:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8430:x1875727265854720:12345-0@lo:502:llog_process_th.0 Request processed in 229us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.239615:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788833036.239765:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8430:1875727265854720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833036.239804:0:8430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833036.239813:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833036.239816:0:8430:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788833036.239821:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788833036.239850:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8430:1875727265854848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833036.239892:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833036.240533:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854848 00000100:00100000:1.0:1788833036.240539:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854848 00000100:00100000:1.0:1788833036.240568:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788833036.240575:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8430:x1875727265854848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833036.240957:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:8430:x1875727265854848:12345-0@lo:502:llog_process_th.0 Request processed in 380us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.240965:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788833036.241156:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.241181:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8430:1875727265854848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833036.241318:0:8430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833036.241325:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833036.241327:0:8430:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788833036.241332:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788833036.241548:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788833036.241569:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788833036.241579:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.242805:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833036.242827:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788833036.242829:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea100dd800 from 39 10000000:01000000:3.0:1788833036.242832:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788833036.242867:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.242876:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.242886:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833036.242907:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.242962:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.243090:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833036.243241:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265854976 00000100:00100000:1.0:1788833036.243248:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265854976 00000100:00100000:1.0:1788833036.243292:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788833036.243485:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265854976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833036.243499:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833036.243511:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe9e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe9e0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.243534:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9e0 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.243544:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9e0 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.243551:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f600, rc 0) 00000100:00100000:1.0:1788833036.243633:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265854976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.243641:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788833036.243748:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265854976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833036.243762:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833036.243772:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833036.243824:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.243849:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.243924:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.243959:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265855104 00000100:00100000:0.0:1788833036.243963:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265855104 00000100:00100000:0.0:1788833036.244065:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788833036.244073:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265855104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833036.244329:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265855104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.244336:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788833036.244445:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.244474:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.244510:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.249954:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833036.250199:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265855232 00000100:00100000:1.0:1788833036.250207:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265855232 00000100:00100000:1.0:1788833036.250267:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788833036.250277:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265855232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.250879:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265855232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 602us (6366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.250888:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788833036.250972:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.251731:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8431:1875727265855360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.251778:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.251815:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.252377:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265855360 00000100:00100000:2.0:1788833036.252384:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265855360 00000100:00100000:2.0:1788833036.252423:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788833036.252431:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:8431:x1875727265855360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.252671:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8431:1875727265855360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.252718:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8431:1875727265855488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.252754:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.252825:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea033933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.252856:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265855488 00000100:00100000:0.0:1788833036.252861:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265855488 00000100:00100000:0.0:1788833036.252936:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788833036.252945:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8431:x1875727265855488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833036.253291:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8431:x1875727265855488:12345-0@lo:502:llog_process_th.0 Request processed in 346us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.253299:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788833036.253433:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8431:1875727265855488:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788833036.253453:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788833036.253819:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788833036.253838:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788833036.253848:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.253859:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833036.253876:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788833036.253879:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788833036.253882:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788833036.253960:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.253969:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.253978:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833036.253995:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.254286:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833036.254436:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.254503:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265855616 00000100:00100000:0.0:1788833036.254508:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265855616 00000100:00100000:0.0:1788833036.254631:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788833036.254638:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265855616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833036.254647:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833036.254659:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe9f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe9ee expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.254679:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9ee expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.254688:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9ee expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.254708:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477800, rc 0) 00000100:00100000:0.0:1788833036.254748:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265855616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.254754:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788833036.254824:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833036.254836:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.254844:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833036.254892:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833036.254937:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8431:x1875727265855360:12345-0@lo:502:llog_process_th.0 Request processed in 2503us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.254937:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833036.254948:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788833036.254960:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.254987:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265855744 00000100:00100000:2.0:1788833036.254992:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265855744 00000100:00100000:2.0:1788833036.255009:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788833036.255015:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265855744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833036.257331:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265855744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1482us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.257345:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788833036.260187:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.260281:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.260372:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833036.260423:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.260462:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265855872 00000100:00100000:0.0:1788833036.260470:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265855872 00000100:00100000:0.0:1788833036.262487:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788833036.262506:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265855872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833036.262827:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265855872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.262835:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788833036.263122:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265855872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833036.263455:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8432:1875727265856000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.263506:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.263558:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03393600 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.263736:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265856000 00000100:00100000:2.0:1788833036.263743:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265856000 00000100:00100000:2.0:1788833036.263781:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788833036.263790:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8432:x1875727265856000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833036.264013:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8432:x1875727265856000:12345-0@lo:502:llog_process_th.0 Request processed in 224us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.264022:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788833036.264061:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8432:1875727265856000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788833036.264093:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788833036.264103:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833036.264105:0:8432:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788833036.264111:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788833036.264133:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8432:1875727265856128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833036.264175:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.264194:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833036.264250:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265856128 00000100:00100000:0.0:1788833036.264255:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265856128 00000100:00100000:0.0:1788833036.264285:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788833036.264292:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8432:x1875727265856128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833036.264444:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8432:x1875727265856128:12345-0@lo:502:llog_process_th.0 Request processed in 152us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.264451:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788833036.264630:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8432:1875727265856128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833036.264657:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833036.264661:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833036.264663:0:8432:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788833036.264667:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788833036.266404:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788833036.266437:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788833036.266448:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.266459:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833036.266535:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788833036.266538:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cea10ad4d28 from 1 10000000:01000000:0.0:1788833036.266541:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788833036.266575:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.266583:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.266608:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833036.266629:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265856256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833036.266679:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833036.266716:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f4d2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.266898:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265856256 00000100:00100000:2.0:1788833036.266905:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265856256 00000100:00100000:2.0:1788833036.266947:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788833036.266955:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265856256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833036.266965:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833036.266976:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01516600/0x8c08e876ed3fea03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fe9fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.266997:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516600/0x8c08e876ed3fea03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9fc expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.267007:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01516600/0x8c08e876ed3fea03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe9fc expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.267015:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516600, rc 0) 00000100:00100000:2.0:1788833036.267071:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265856256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.267076:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788833036.267155:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265856256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833036.267169:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea03 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.267177:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fea03 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833036.267237:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265856384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833036.267261:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833036.267289:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833036.267788:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265856384 00000100:00100000:2.0:1788833036.267794:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265856384 00000100:00100000:2.0:1788833036.267833:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788833036.267841:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265856384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833036.268073:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265856384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (810us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788833036.268088:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788833036.268168:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265856384:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788833036.268197:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788833036.268204:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea03 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.268212:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea03 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.270240:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833036.397748:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833036.397770:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265856512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833036.397829:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.398488:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265856512 00000100:00100000:3.0:1788833036.398495:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265856512 00000100:00100000:3.0:1788833036.398623:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788833036.398633:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265856512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833036.398668:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833036.398724:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265856512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.398732:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788833036.398790:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb64380 x1875727265856512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833036.398810:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265856512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833036.398984:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265856640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833036.399020:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.399417:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265856640 00000100:00100000:3.0:1788833036.399423:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265856640 00000100:00100000:3.0:1788833036.399492:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788833036.399500:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265856640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788833036.399520:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833036.399564:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265856640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.399570:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788833036.399618:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea26f5c380 x1875727265856640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833036.399632:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265856640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833036.623602:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833036.623773:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392448 00000100:00100000:2.0:1788833036.623782:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392448 00000100:00100000:2.0:1788833036.623887:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 163 00000100:00100000:2.0:1788833036.623899:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:5599:x1875727256392448:12345-192.168.206.55@tcp:101: 00010000:00010000:2.0:1788833036.623916:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833036.623935:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fea0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ad96 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.623964:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fea0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad96 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.623977:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fea0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad96 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833036.623986:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517600, rc 0) 00000100:00100000:2.0:1788833036.624506:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5599:x1875727256392448:12345-192.168.206.55@tcp:101: Request processed in 608us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.624514:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 163 00000100:00100000:3.0:1788833036.631637:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833036.632659:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392576 00000100:00100000:0.0:1788833036.632669:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392576 00000100:00100000:0.0:1788833036.632724:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 164 00000100:00100000:0.0:1788833036.632733:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5599:x1875727256392576:12345-192.168.206.55@tcp:501: 00000100:00100000:0.0:1788833036.633476:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5599:x1875727256392576:12345-192.168.206.55@tcp:501: Request processed in 741us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.633486:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 164 00000100:00100000:3.0:1788833036.635677:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833036.640767:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392704 00000100:00100000:2.0:1788833036.640787:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392704 00000100:00100000:2.0:1788833036.640885:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 165 00000100:00100000:2.0:1788833036.640898:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5599:x1875727256392704:12345-192.168.206.55@tcp:503: 00000100:00100000:2.0:1788833036.642585:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5599:x1875727256392704:12345-192.168.206.55@tcp:503: Request processed in 1676us (6906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.642617:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 165 00000100:00100000:3.0:1788833036.656720:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833036.656830:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392832 00000100:00100000:0.0:1788833036.656844:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392832 00000100:00100000:0.0:1788833036.656912:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 166 00000100:00100000:0.0:1788833036.656923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:6071:x1875727256392832:12345-192.168.206.55@tcp:502: 00000100:00100000:0.0:1788833036.657250:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:6071:x1875727256392832:12345-192.168.206.55@tcp:502: Request processed in 328us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.657265:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 166 00000100:00100000:3.0:1788833036.659497:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833036.659796:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256392960 00000100:00100000:2.0:1788833036.659809:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256392960 00000100:00100000:2.0:1788833036.659873:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 167 00000100:00100000:2.0:1788833036.659884:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:6071:x1875727256392960:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788833036.660301:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:6071:x1875727256392960:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 417us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.660311:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 167 00000100:00100000:3.0:1788833036.670426:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833036.670604:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393088 00000100:00100000:1.0:1788833036.670618:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393088 00000100:00100000:1.0:1788833036.670734:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 168 00000100:00100000:1.0:1788833036.670746:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5599:x1875727256393088:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833036.670764:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833036.670783:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932f400/0x8c08e876ed3fea11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ad9d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.670813:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932f400/0x8c08e876ed3fea11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad9d expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.670825:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932f400/0x8c08e876ed3fea11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad9d expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.670834:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f400, rc 0) 00000100:00100000:1.0:1788833036.670901:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393088:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 157us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.670908:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 168 00000100:00100000:3.0:1788833036.674606:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833036.674734:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393216 00000100:00100000:2.0:1788833036.674748:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393216 00000100:00100000:2.0:1788833036.674820:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 169 00000100:00100000:2.0:1788833036.674833:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393216:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833036.675292:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393216:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 459us (698us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788833036.675302:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 169 00010000:00010000:2.0:1788833037.293361:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788833037.752323:0:8470:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0ffceab0 20000000:00000080:0.0:1788833037.752348:0:8470:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cea3f599c00 uarg=0000000000000000 20000000:01000000:0.0:1788833037.752406:0:8470:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788833037.752413:0:8470:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788833037.752419:0:8470:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788833037.759050:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788833037.759262:0:8470:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788833037.770485:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788833037.770550:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788833037.770614:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788833037.770635:0:8470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788833037.770662:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.770686:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3fe78d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.770695:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.770702:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.770713:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.770722:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.770773:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.770805:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 9 pid: 5804 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833037.770824:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265856768:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833037.771447:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.771458:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 18 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833037.771471:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265856896:0@lo:104: 00000100:00100000:0.0:1788833037.771518:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788833037.771567:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.771576:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 18 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833037.771584:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265857024:0@lo:104: 00000100:00100000:0.0:1788833037.771605:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788833037.771631:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3fe78d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.771639:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3fe78d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 18 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833037.771646:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265857152:0@lo:104: 00000100:00100000:0.0:1788833037.771661:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833037.772015:0:7599:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788833037.772331:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833037.772412:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265856896 00000100:00100000:2.0:1788833037.772424:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265856896 00000100:00100000:1.0:1788833037.772476:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857024 00000100:00100000:2.0:1788833037.772479:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857152 00000100:00100000:2.0:1788833037.772483:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857152 00000100:00100000:1.0:1788833037.772484:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857024 00000100:00100000:2.0:1788833037.772502:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788833037.772515:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:8470:x1875727265856896:12345-0@lo:104: 00000100:00100000:1.0:1788833037.772522:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788833037.772535:0:7599:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833037.772535:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:8470:x1875727265857152:12345-0@lo:104: 00010000:00010000:1.0:1788833037.772552:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.772647:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788833037.772661:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:8470:x1875727265857152:12345-0@lo:104: Request processed in 129us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833037.772669:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788833037.772691:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788833037.772698:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40984450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:8470:x1875727265857024:12345-0@lo:104: 00010000:00010000:1.0:1788833037.772716:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833037.773529:0:7599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788833037.773540:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:8470:x1875727265856896:12345-0@lo:104: Request processed in 1028us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833037.773548:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788833037.773653:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265856896:0@lo:104: 00010000:00010000:3.0:1788833037.773771:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788833037.773780:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.773790:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dce00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:3.0:1788833037.773795:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.773806:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788833037.773814:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833037.773822:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788833037.773929:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.773937:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788833037.773967:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.773974:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fe786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe78d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.773999:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833037.774002:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.774023:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:3.0:1788833037.774026:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.774052:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788833037.774063:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833037.774068:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788833037.774141:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265857024:0@lo:104: 00010000:00010000:1.0:1788833037.774142:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788833037.774154:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40984450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:8470:x1875727265857024:12345-0@lo:104: Request processed in 1455us (2545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833037.774159:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265857152:0@lo:104: 00000100:00100000:1.0:1788833037.774167:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788833037.774228:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788833037.774258:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265857280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788833037.774322:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833037.774466:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.774472:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788833037.774542:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.774550:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01516c00/0x8c08e876ed3fe8b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe8ba expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.774559:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833037.774560:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833037.774562:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833037.774574:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265857408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788833037.774598:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833037.774647:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857280 00000100:00100000:2.0:1788833037.774656:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857280 00010000:00010000:2.0:1788833037.774687:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3fe78d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 19 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833037.774721:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857408 00000100:00100000:2.0:1788833037.774724:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857408 00010000:00010000:2.0:1788833037.774737:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 20 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833037.774757:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788833037.774765:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+20:3279:x1875727265857280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833037.774779:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833037.774785:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3fe78d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 20 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833037.774795:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3fe78d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 20 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833037.774814:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3fe78d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe786 expref: 20 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833037.774831:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833037.774868:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265857280:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833037.774886:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788833037.774898:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265857408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833037.774900:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788833037.774914:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833037.774921:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 19 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.774932:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 19 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.774945:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516000/0x8c08e876ed3fe8ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe8b3 expref: 19 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.774957:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833037.775000:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3276:x1875727265857408:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833037.775007:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788833037.775014:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265857408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788833037.775892:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833037.775963:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393344 00000100:00100000:1.0:1788833037.775968:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265857280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788833037.775982:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393344 00010000:00010000:3.0:1788833037.776011:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 10 pid: 5804 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833037.776090:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875727265856768:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833037.776125:0:8470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833037.776244:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833037.776248:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833037.776250:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833037.776258:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:3.0:1788833037.776268:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2358:x1875727256393344:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833037.776282:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833037.776288:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 10 pid: 5804 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.776301:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 10 pid: 5804 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.776317:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fe977 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad65 expref: 10 pid: 5804 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833037.776334:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833037.776367:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.776378:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea42166600 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:0.0:1788833037.776383:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833037.776393:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:2358:x1875727256393344:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 125us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833037.776407:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00010000:00010000:0.0:1788833037.776408:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788833037.776418:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833037.776425:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788833037.776593:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.776601:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788833037.776626:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833037.776631:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788833037.776638:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea42166600/0x8c08e876ed3fe7e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fe7ef expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833037.776648:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265857536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788833037.776659:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833037.776662:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833037.776664:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833037.776690:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833037.776809:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857536 00000100:00100000:1.0:1788833037.776815:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857536 00010000:00010000:1.0:1788833037.776836:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 17 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833037.776866:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788833037.776874:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3276:x1875727265857536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788833037.776884:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833037.776888:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 17 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776910:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 17 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776922:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477400/0x8c08e876ed3fe7ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fe7e8 expref: 17 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776938:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776947:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776965:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776972:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776980:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776986:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.776992:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833037.776996:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.777004:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.777056:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833037.777067:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833037.777104:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3276:x1875727265857536:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833037.777112:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788833037.777143:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265857536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788833037.777570:0:8470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.777581:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833037.777589:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477600/0x8c08e876ed3fea18 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833038.318502:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833038.412580:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833038.412696:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393472 00000100:00100000:2.0:1788833038.412710:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393472 00000100:00100000:2.0:1788833038.412796:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 170 00000100:00100000:2.0:1788833038.412808:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:5599:x1875727256393472:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833038.412831:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833038.412861:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ada4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833038.412912:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833038.412925:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833038.412937:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516c00, rc 0) 00000100:00100000:2.0:1788833038.413025:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393472:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 219us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833038.413063:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 170 00000100:00100000:2.0:1788833038.423704:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833038.423895:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393600 00000100:00100000:3.0:1788833038.423907:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393600 00000100:00100000:3.0:1788833038.424143:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 171 00000100:00100000:3.0:1788833038.424157:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393600:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833038.430852:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393600:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 6281us (6746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833038.430875:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 171 00000100:00100000:1.0:1788833038.432461:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833038.432538:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393728 00000100:00100000:3.0:1788833038.432549:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393728 00000100:00100000:3.0:1788833038.432611:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 172 00000100:00100000:3.0:1788833038.432623:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393728:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833038.433261:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:5599:x1875727256393728:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 636us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833038.433272:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 172 00000100:00100000:3.0:1788833038.439381:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833038.441289:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393856 00000100:00100000:0.0:1788833038.441334:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393856 00000100:00100000:0.0:1788833038.441415:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 173 00000100:00100000:0.0:1788833038.441756:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:6128:x1875727256393856:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833038.443383:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:6128:x1875727256393856:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 1944us (4443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833038.443398:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 173 00000100:00100000:2.0:1788833038.454526:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833038.454704:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256393984 00000100:00100000:3.0:1788833038.454718:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256393984 00000100:00100000:3.0:1788833038.454916:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 174 00000100:00100000:3.0:1788833038.454930:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:6128:x1875727256393984:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788833038.455681:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:6128:x1875727256393984:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 749us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833038.455693:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 174 00010000:00010000:2.0:1788833039.343989:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788833039.406211:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788833039.406218:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea06626000 from 4 10000000:01000000:2.0:1788833039.406222:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788833039.406276:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833039.406288:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833039.406300:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833039.406325:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265857664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788833039.406389:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833039.406438:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788833039.408717:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857664 00000100:00100000:0.0:1788833039.408730:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857664 00000100:00100000:0.0:1788833039.408905:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788833039.408916:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265857664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833039.408932:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833039.408949:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fea26 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833039.408978:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833039.408990:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833039.408999:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476e00, rc 0) 00000100:00100000:0.0:1788833039.409099:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265857664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (2709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833039.409107:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788833039.409123:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265857664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833039.409143:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.409160:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833039.409385:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265857792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.409422:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833039.409449:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857792 00000100:00100000:2.0:1788833039.409455:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857792 00000100:00100000:3.0:1788833039.409460:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03136a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788833039.409483:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788833039.409493:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265857792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833039.409729:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265857792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833039.409736:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788833039.410608:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265857792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.410656:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265857920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.410706:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.410744:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03136a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833039.410797:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265857920 00000100:00100000:0.0:1788833039.410803:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265857920 00000100:00100000:0.0:1788833039.410851:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788833039.410860:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265857920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833039.411051:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265857920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833039.411059:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788833039.411251:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265857920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.415522:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8559:1875727265858048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833039.415600:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.415642:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03136a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833039.415837:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858048 00000100:00100000:0.0:1788833039.415844:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858048 00000100:00100000:0.0:1788833039.415894:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788833039.415903:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:8559:x1875727265858048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833039.416566:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:8559:x1875727265858048:12345-0@lo:502:llog_process_th.0 Request processed in 663us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833039.416574:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788833039.416761:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8559:1875727265858048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788833039.416796:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788833039.416806:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833039.416809:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788833039.416826:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea06626000 00000020:00000080:3.0:1788833039.416830:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788833039.420696:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8559:1875727265858176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833039.420792:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.420855:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1252da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833039.421130:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858176 00000100:00100000:1.0:1788833039.421142:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858176 00000100:00100000:1.0:1788833039.421192:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788833039.421201:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:8559:x1875727265858176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833039.421441:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:8559:x1875727265858176:12345-0@lo:502:llog_process_th.0 Request processed in 240us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833039.421448:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788833039.421656:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8559:1875727265858176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788833039.421692:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788833039.421700:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833039.421707:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788833039.421712:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788833039.421937:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788833039.421956:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788833039.421965:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833039.421976:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833039.421986:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788833039.421989:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea1fc5c800 from 4 10000000:01000000:1.0:1788833039.421997:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788833039.422056:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833039.422065:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833039.422075:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833039.422188:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788833039.422235:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833039.422263:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f4056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833039.422306:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858304 00000100:00100000:3.0:1788833039.422312:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858304 00000100:00100000:3.0:1788833039.422359:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788833039.422368:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265858304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833039.422377:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833039.422390:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fea34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.422414:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.422425:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.422433:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833039.422472:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265858304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833039.422478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788833039.422512:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833039.422524:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.422533:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833039.422577:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.422603:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.422626:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1252da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788833039.422638:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858432 00000100:00100000:3.0:1788833039.422641:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858432 00000100:00100000:3.0:1788833039.422663:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788833039.422669:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265858432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.422990:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265858432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833039.422998:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788833039.423054:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.423221:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.423262:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.423286:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03393c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833039.424231:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858560 00000100:00100000:1.0:1788833039.424238:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858560 00000100:00100000:1.0:1788833039.424273:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788833039.424281:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265858560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833039.424461:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265858560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833039.424468:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788833039.424758:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.430987:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8562:1875727265858688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833039.434148:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.434234:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03393c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833039.434922:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858688 00000100:00100000:0.0:1788833039.434933:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858688 00000100:00100000:0.0:1788833039.434991:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788833039.435002:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8562:x1875727265858688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833039.435292:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8562:x1875727265858688:12345-0@lo:502:llog_process_th.0 Request processed in 292us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833039.435301:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788833039.436412:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8562:1875727265858688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788833039.436452:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788833039.436463:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833039.436466:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788833039.436473:0:8562:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea1fc5c800 00000020:00000080:3.0:1788833039.436477:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788833039.436931:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8562:1875727265858816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833039.436989:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.437052:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea0890f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788833039.437076:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858816 00000100:00100000:2.0:1788833039.437155:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858816 00000100:00100000:2.0:1788833039.437213:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788833039.437222:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8562:x1875727265858816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833039.437431:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:8562:x1875727265858816:12345-0@lo:502:llog_process_th.0 Request processed in 210us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833039.437439:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788833039.437484:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8562:1875727265858816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788833039.437504:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788833039.437509:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833039.437511:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788833039.437516:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788833039.437568:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788833039.437586:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833039.437595:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.437605:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833039.437614:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788833039.437617:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea100dd800 from 4 10000000:01000000:3.0:1788833039.437619:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833039.437652:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.437661:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.437669:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833039.437682:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.438021:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.438079:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea0890f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788833039.438962:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265858944 00000100:00100000:2.0:1788833039.438971:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265858944 00000100:00100000:2.0:1788833039.439028:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788833039.439057:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265858944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833039.439069:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833039.439169:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fea42 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833039.439197:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833039.439218:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833039.439227:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:2.0:1788833039.439279:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265858944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833039.439287:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788833039.439413:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265858944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833039.439430:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833039.439446:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833039.439514:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265859072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.439547:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.439617:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea0890f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788833039.441572:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859072 00000100:00100000:2.0:1788833039.441584:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859072 00000100:00100000:2.0:1788833039.441674:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788833039.441685:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265859072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833039.441994:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265859072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833039.442002:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788833039.442299:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265859072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833039.442357:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265859200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833039.442409:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833039.442692:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405600 going to sleep for 11 seconds 00000100:00100000:3.0:1788833039.442728:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859200 00000100:00100000:3.0:1788833039.442733:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859200 00000100:00100000:3.0:1788833039.442763:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788833039.442771:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265859200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833039.443045:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265859200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833039.443053:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788833039.443611:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265859200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833039.445952:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39559c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8565:1875727265859328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833039.446025:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833039.446079:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f4d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788833039.446318:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859328 00000100:00100000:3.0:1788833039.446326:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859328 00000100:00100000:3.0:1788833039.446370:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788833039.446380:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:8565:x1875727265859328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833039.446600:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:8565:x1875727265859328:12345-0@lo:502:llog_process_th.0 Request processed in 220us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833039.446608:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788833039.446907:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39559c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8565:1875727265859328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833039.446946:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833039.446956:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833039.446958:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788833039.446966:0:8565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea100dd800 00000020:00000080:2.0:1788833039.446969:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788833039.447060:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39559c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8565:1875727265859456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833039.447100:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833039.447126:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859456 00000100:00100000:2.0:1788833039.447130:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859456 00000100:00100000:2.0:1788833039.447154:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788833039.447162:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:8565:x1875727265859456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833039.447319:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:8565:x1875727265859456:12345-0@lo:502:llog_process_th.0 Request processed in 158us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833039.447326:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788833039.447359:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f4d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833039.447370:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39559c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:8565:1875727265859456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833039.447386:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833039.447390:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833039.447391:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788833039.447395:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788833039.447464:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788833039.447484:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788833039.447501:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833039.447512:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833040.372345:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833041.005208:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265859584:0@lo:400:kworker.0 00000100:00100000:2.0:1788833041.005232:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265859712:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.005259:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265859840:0@lo:400:kworker.0 00000100:00100000:2.0:1788833041.005302:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833041.005308:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.005316:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265859968:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.005366:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833041.005395:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265860096:0@lo:400:kworker.0 00000100:00100000:2.0:1788833041.005396:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265860224:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.005412:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859968 00000100:00100000:0.0:1788833041.005420:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859968 00000100:00100000:3.0:1788833041.005436:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833041.005443:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.005474:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860224 00000100:00100000:0.0:1788833041.005478:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860224 00000100:00100000:2.0:1788833041.005490:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859712 00000100:00100000:2.0:1788833041.005496:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859712 00000100:00100000:0.0:1788833041.005513:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788833041.005532:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265859968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833041.005538:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860096 00000100:00100000:2.0:1788833041.005550:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860096 00000100:00100000:2.0:1788833041.005581:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788833041.005591:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265859712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.005598:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265859968:12345-0@lo:400:kworker.0 Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833041.005599:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859584 00000100:00100000:3.0:1788833041.005606:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859584 00000100:00100000:0.0:1788833041.005611:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788833041.005642:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788833041.005650:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265859584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833041.005686:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265859584:12345-0@lo:400:kworker.0 Request processed in 37us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833041.005694:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788833041.005724:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788833041.005731:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788833041.005826:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265859712:12345-0@lo:400:kworker.0 Request processed in 236us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833041.005834:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788833041.005843:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788833041.005854:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265860224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833041.005858:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265859584:0@lo:400:kworker.0 00000100:00100000:2.0:1788833041.005860:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788833041.005873:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265860096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.005900:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265860224:12345-0@lo:400:kworker.0 Request processed in 48us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.005909:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788833041.005926:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265860096:12345-0@lo:400:kworker.0 Request processed in 54us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833041.005935:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788833041.005936:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788833041.005942:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788833041.005946:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833041.005974:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833041.005990:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265860096:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.006008:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265859840 00000100:00100000:0.0:1788833041.006013:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265859840 00010000:00080000:2.0:1788833041.006026:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb66300 x1875727265860224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833041.006060:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265860224:0@lo:400:kworker.0 00000100:00100000:2.0:1788833041.006076:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265859712:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.006081:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788833041.006091:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265859840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.006150:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265859840:12345-0@lo:400:kworker.0 Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.006157:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788833041.006173:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788833041.006193:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb67100 x1875727265859968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833041.006212:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265859840:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.006217:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265859968:0@lo:400:kworker.0 00000100:00100000:1.0:1788833041.100604:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833041.100786:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256394112 00000100:00100000:0.0:1788833041.100798:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256394112 00000100:00100000:0.0:1788833041.100857:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 191 00000100:00100000:0.0:1788833041.100879:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2357:x1875727256394112:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833041.100952:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2357:x1875727256394112:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 75us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.100960:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 191 00000100:00100000:1.0:1788833041.107577:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833041.107688:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833041.107718:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833041.107808:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256394368 00000100:00100000:2.0:1788833041.107817:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256394368 00000100:00100000:0.0:1788833041.107908:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256394496 00000100:00100000:0.0:1788833041.107912:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256394496 00000100:00100000:0.0:1788833041.111028:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:0.0:1788833041.111056:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256394496:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833041.111132:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256394496:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 80us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.111140:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00080000:1.0:1788833041.111884:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833041.111892:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788833041.112075:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:2.0:1788833041.112084:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256394368:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833041.112251:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256394368:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 58us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833041.112259:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:2.0:1788833041.112299:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256394240 00000100:00100000:2.0:1788833041.112307:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256394240 00000100:00100000:2.0:1788833041.112416:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:2.0:1788833041.112424:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256394240:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833041.112452:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256394240:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 30us (4834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833041.112459:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00080000:2.0:1788833041.112473:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788833041.397611:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833041.517222:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833041.517245:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265860352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833041.517324:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833041.517505:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860352 00000100:00100000:3.0:1788833041.517513:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860352 00000100:00100000:3.0:1788833041.517567:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788833041.517576:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265860352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833041.517614:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833041.517671:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265860352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833041.517678:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788833041.517753:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea26f5d180 x1875727265860352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833041.517772:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265860352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833041.526513:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265860480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833041.526585:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833041.527318:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860480 00000100:00100000:3.0:1788833041.527328:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860480 00000100:00100000:3.0:1788833041.527386:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788833041.527396:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265860480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788833041.527435:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833041.528918:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265860480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1517us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833041.528930:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788833041.536529:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb67100 x1875727265860480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833041.536564:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265860480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788833042.413311:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788833043.320445:0:8771:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788833043.437162:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833044.465754:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833045.486126:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833046.128376:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265860736:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128452:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833046.128495:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265861248:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128518:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833046.128546:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788833046.128551:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265860608:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833046.128600:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265861120:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128631:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833046.128657:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265860864:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128676:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833046.128690:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833046.128694:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265860992:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128711:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833046.128753:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860736 00000100:00100000:1.0:1788833046.128761:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860736 00000100:00100000:1.0:1788833046.128802:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265861120 00000100:00100000:1.0:1788833046.128805:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265861120 00000100:00100000:1.0:1788833046.128824:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860864 00000100:00100000:1.0:1788833046.128826:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860864 00000100:00100000:1.0:1788833046.128841:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788833046.128849:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265860736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128900:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265860736:12345-0@lo:400:kworker.0 Request processed in 51us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833046.128908:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788833046.128923:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788833046.128930:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265861120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.128968:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265861120:12345-0@lo:400:kworker.0 Request processed in 39us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833046.128974:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788833046.128987:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788833046.128993:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265860864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.129024:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265860864:12345-0@lo:400:kworker.0 Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833046.129050:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788833046.129070:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265861248 00000100:00100000:1.0:1788833046.129073:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265861248 00000100:00100000:1.0:1788833046.129094:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860992 00000100:00100000:1.0:1788833046.129097:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860992 00000100:00100000:1.0:1788833046.129116:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788833046.129122:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265861248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.129154:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265861248:12345-0@lo:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833046.129160:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788833046.129181:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788833046.129188:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265860992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.129214:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265860992:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833046.129219:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788833046.129259:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea396c1f80 x1875727265860992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833046.129272:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265860992:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.129283:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265860864:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.129323:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265861120:0@lo:400:kworker.0 00000100:00100000:1.0:1788833046.129333:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265860736:0@lo:400:kworker.0 00010000:00080000:1.0:1788833046.129342:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea396c0e00 x1875727265861248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833046.129350:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265861248:0@lo:400:kworker.0 00000100:00080000:2.0:1788833046.129514:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833046.129518:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833046.129521:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833046.129548:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265860608 00000100:00100000:2.0:1788833046.129552:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265860608 00000100:00100000:2.0:1788833046.129590:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788833046.129597:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265860608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833046.129636:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265860608:12345-0@lo:400:kworker.0 Request processed in 40us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833046.129642:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788833046.129834:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265860608:0@lo:400:kworker.0 00000100:00100000:2.0:1788833046.225011:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833046.225079:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833046.225107:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833046.225136:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833046.225162:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256394880 00000100:00100000:2.0:1788833046.225184:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256394880 00000100:00100000:2.0:1788833046.225237:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395008 00000100:00100000:2.0:1788833046.225241:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395008 00000100:00100000:2.0:1788833046.225263:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:2.0:1788833046.225272:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256394880:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833046.225352:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256394880:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 80us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833046.225361:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:2.0:1788833046.225379:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:2.0:1788833046.225387:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256395008:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833046.225412:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256395008:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833046.225418:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:2.0:1788833046.225436:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256394752 00000100:00100000:2.0:1788833046.225439:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256394752 00000100:00100000:2.0:1788833046.225469:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:2.0:1788833046.225475:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256394752:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833046.225502:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256394752:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833046.225508:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00080000:2.0:1788833046.225527:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788833046.225532:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833046.225534:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833046.225713:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256394624 00000100:00100000:0.0:1788833046.225718:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256394624 00000100:00100000:0.0:1788833046.225759:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 193 00000100:00100000:0.0:1788833046.225767:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2357:x1875727256394624:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833046.225802:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2357:x1875727256394624:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 36us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.225808:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 193 00010000:00010000:0.0:1788833046.509214:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833046.637560:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265861376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833046.637627:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833046.637691:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833046.637698:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265861504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833046.637719:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833046.637803:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265861376 00000100:00100000:3.0:1788833046.637823:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265861376 00000100:00100000:3.0:1788833046.637858:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265861504 00000100:00100000:3.0:1788833046.637861:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265861504 00000100:00100000:3.0:1788833046.637875:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788833046.637882:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265861376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833046.637913:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833046.637962:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265861376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.637968:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788833046.637986:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788833046.637993:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265861504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788833046.638021:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833046.638083:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265861504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.638090:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788833046.638393:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb67100 x1875727265861504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833046.638411:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265861504:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788833046.638423:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea26f5ea00 x1875727265861376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833046.638434:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265861376:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788833047.485576:0:9016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing yml_node 00010000:00010000:1.0:1788833047.534906:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833048.559260:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833049.581581:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833050.606085:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833051.245411:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265861632:0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.245449:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265861760:0@lo:400:kworker.0 00000100:00100000:3.0:1788833051.251929:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833051.252063:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265862144:0@lo:400:kworker.0 00000100:00100000:3.0:1788833051.252153:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833051.252222:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862144 00000100:00100000:3.0:1788833051.252233:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862144 00000100:00100000:3.0:1788833051.252304:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788833051.252314:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265862144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833051.252373:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265862144:12345-0@lo:400:kworker.0 Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833051.252400:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788833051.252418:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788833051.252427:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833051.252441:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265861760 00000100:00100000:3.0:1788833051.252445:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265861760 00000100:00100000:1.0:1788833051.252459:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265862272:0@lo:400:kworker.0 00000100:00100000:3.0:1788833051.252472:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788833051.252480:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265861760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833051.252513:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265861760:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833051.252519:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788833051.252577:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265862144:0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.252932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833051.253189:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862272 00000100:00100000:2.0:1788833051.253196:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862272 00000100:00100000:2.0:1788833051.253250:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788833051.253259:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265862272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833051.253386:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265862272:12345-0@lo:400:kworker.0 Request processed in 128us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833051.253394:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788833051.253469:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265861760:0@lo:400:kworker.0 00010000:00080000:1.0:1788833051.253483:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea39558e00 x1875727265862272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833051.253566:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265862272:0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.253675:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265861888:0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.253950:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833051.254026:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833051.254054:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265862016:0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.254172:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833051.254232:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265861632 00000100:00100000:1.0:1788833051.254239:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265861632 00000100:00100000:1.0:1788833051.254285:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788833051.254292:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265861632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.254341:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265861632:12345-0@lo:400:kworker.0 Request processed in 49us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833051.254348:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788833051.254436:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265861888 00000100:00100000:2.0:1788833051.254441:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265861888 00000100:00100000:2.0:1788833051.254475:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788833051.254483:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265861888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833051.254537:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265861888:12345-0@lo:400:kworker.0 Request processed in 55us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833051.254545:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788833051.254782:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862016 00000100:00100000:1.0:1788833051.254787:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862016 00000100:00100000:1.0:1788833051.254824:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788833051.254831:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265862016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.254867:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265862016:12345-0@lo:400:kworker.0 Request processed in 37us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833051.254873:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788833051.254912:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3955ad80 x1875727265862016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833051.254932:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265862016:0@lo:400:kworker.0 00000100:00100000:1.0:1788833051.254945:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265861888:0@lo:400:kworker.0 00000100:00080000:3.0:1788833051.256677:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833051.256691:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788833051.256695:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833051.256756:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265861632:0@lo:400:kworker.0 00000100:00100000:2.0:1788833051.346556:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833051.346601:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833051.346633:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833051.346661:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833051.346692:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395392 00000100:00100000:2.0:1788833051.346705:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395392 00000100:00100000:2.0:1788833051.346777:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395520 00000100:00100000:2.0:1788833051.346781:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395520 00000100:00100000:2.0:1788833051.346807:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:2.0:1788833051.346819:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2356:x1875727256395392:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:2.0:1788833051.346866:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe985 00000100:00080000:2.0:1788833051.346878:0:6656:0:(import.c:65:import_set_state_nolock()) ffff9ce901277800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788833051.346930:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788833051.347415:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+2:2356:x1875727256395392:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 597us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833051.347426:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:2.0:1788833051.347446:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:2.0:1788833051.347455:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2356:x1875727256395520:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:2.0:1788833051.347472:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe98c 00000100:00080000:2.0:1788833051.347478:0:6656:0:(import.c:65:import_set_state_nolock()) ffff9ce901274000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788833051.347520:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788833051.347719:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+2:2356:x1875727256395520:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 265us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833051.347726:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00080000:2.0:1788833051.347752:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833051.347758:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788833051.347779:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833051.347922:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833051.348170:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395136 00000100:00100000:3.0:1788833051.348180:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395136 00000100:00100000:3.0:1788833051.348225:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 195 00000100:00100000:3.0:1788833051.348234:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2360:x1875727256395136:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833051.348280:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2360:x1875727256395136:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 48us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833051.348288:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 195 00000100:00100000:0.0:1788833051.349091:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395264 00000100:00100000:0.0:1788833051.349100:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395264 00000100:00100000:0.0:1788833051.349256:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:0.0:1788833051.349265:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256395264:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833051.349328:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256395264:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 64us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833051.349336:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00080000:3.0:1788833051.349695:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788833051.629684:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833051.757275:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833051.757310:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265862400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833051.757409:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833051.757507:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862400 00000100:00100000:1.0:1788833051.757517:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862400 00000100:00100000:1.0:1788833051.757576:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788833051.757586:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265862400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833051.757631:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833051.757686:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265862400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833051.757694:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788833051.757746:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902702680 x1875727265862400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833051.757782:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265862400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833051.758019:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265862528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833051.758081:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833051.758163:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862528 00000100:00100000:3.0:1788833051.758168:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862528 00000100:00100000:3.0:1788833051.758206:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788833051.758214:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265862528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833051.758257:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833051.758300:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265862528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833051.758308:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788833051.758390:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea26f5ed80 x1875727265862528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833051.758407:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265862528:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788833051.803712:0:9209:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.106 00010000:00010000:2.0:1788833052.654837:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833053.677302:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788833054.149645:0:9306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.106 00000001:00100000:0.0:1788833054.378966:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:0.0:1788833054.379053:0:6679:0:(genops.c:885:class_export_put()) final put ffff9ce901272000/458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:3.0:1788833054.379188:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce901272000/458534c2-c478-4b32-bcda-93b4ecf625e9 for lustre-OST0000 00000020:00000080:3.0:1788833054.379234:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ce901277800 for lustre-OST0000 00010000:00010000:1.0:1788833054.710589:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833055.725264:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788833055.918139:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:1.0:1788833055.918153:0:7611:0:(genops.c:885:class_export_put()) final put ffff9ce901277000/458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:1.0:1788833055.918215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce901277000/458534c2-c478-4b32-bcda-93b4ecf625e9 for lustre-OST0001 00000020:00000080:1.0:1788833055.918276:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ce901274000 for lustre-OST0001 00000100:00100000:1.0:1788833056.369710:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265862784:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.369808:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833056.369873:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265863296:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.369903:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833056.369937:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788833056.369944:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265862656:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.369976:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833056.369999:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265863168:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370022:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833056.370080:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265863040:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370106:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833056.370136:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833056.370142:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265862912:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370163:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833056.370196:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862784 00000100:00100000:1.0:1788833056.370205:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862784 00000100:00100000:1.0:1788833056.370251:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863168 00000100:00100000:1.0:1788833056.370254:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863168 00000100:00100000:1.0:1788833056.370275:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862912 00000100:00100000:1.0:1788833056.370277:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862912 00000100:00100000:1.0:1788833056.370295:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788833056.370304:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265862784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370364:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265862784:12345-0@lo:400:kworker.0 Request processed in 60us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833056.370385:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788833056.370405:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788833056.370411:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265863168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370439:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265863168:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833056.370444:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788833056.370455:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788833056.370461:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265862912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370488:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265862912:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833056.370493:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788833056.370511:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265862656 00000100:00100000:1.0:1788833056.370514:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265862656 00000100:00100000:1.0:1788833056.370539:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788833056.370545:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265862656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370573:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265862656:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833056.370579:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788833056.370633:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265862912:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370664:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265862656:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370674:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265863168:0@lo:400:kworker.0 00000100:00100000:1.0:1788833056.370684:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265862784:0@lo:400:kworker.0 00000100:00100000:2.0:1788833056.370835:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863296 00000100:00100000:2.0:1788833056.370840:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863296 00000100:00100000:2.0:1788833056.370882:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863040 00000100:00100000:2.0:1788833056.370885:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863040 00000100:00100000:2.0:1788833056.370910:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788833056.370917:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265863296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833056.370960:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265863296:12345-0@lo:400:kworker.0 Request processed in 44us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833056.370966:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788833056.370978:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788833056.370983:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265863040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833056.371011:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265863040:12345-0@lo:400:kworker.0 Request processed in 28us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833056.371016:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788833056.371075:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902701880 x1875727265863040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833056.371102:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265863040:0@lo:400:kworker.0 00010000:00080000:2.0:1788833056.371142:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902703100 x1875727265863296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833056.371152:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265863296:0@lo:400:kworker.0 00000100:00080000:3.0:1788833056.371284:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833056.371290:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833056.371293:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833056.461141:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833056.461196:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833056.461279:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395776 00000100:00100000:1.0:1788833056.461305:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395776 00000100:00100000:1.0:1788833056.461394:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:1.0:1788833056.461406:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256395776:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833056.461501:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256395776:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833056.461510:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00080000:0.0:1788833056.461835:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833056.462114:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395648 00000100:00100000:3.0:1788833056.462132:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395648 00000100:00100000:3.0:1788833056.462178:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 197 00000100:00100000:3.0:1788833056.462188:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2359:x1875727256395648:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833056.462247:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2359:x1875727256395648:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 60us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833056.462255:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 197 00000001:02000400:0.0:1788833056.623890:0:9406:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.106 00010000:00010000:2.0:1788833056.750279:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833056.877191:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265863552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833056.877287:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833056.878417:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265863424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833056.878484:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833056.878663:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863552 00000100:00100000:2.0:1788833056.878674:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863552 00000100:00100000:2.0:1788833056.878722:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863424 00000100:00100000:2.0:1788833056.878726:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863424 00000100:00100000:2.0:1788833056.878742:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788833056.878751:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265863552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833056.879124:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833056.879920:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265863552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1164us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833056.879932:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788833056.879965:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788833056.879976:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265863424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833056.880007:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833056.880080:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265863424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833056.880086:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788833056.880146:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea26f5f100 x1875727265863424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833056.880188:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265863424:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788833056.883279:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb65f80 x1875727265863552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833056.883311:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265863552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788833057.773307:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788833058.370613:0:9455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 22:04:16 EDT 2026 00010000:00010000:2.0:1788833058.798773:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833059.825389:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833060.846538:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833061.487477:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265863680:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.487585:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833061.487639:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265864192:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.487668:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833061.487696:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788833061.487701:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265863808:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.487720:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833061.487735:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265864320:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.487759:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833061.487800:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265863936:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.487825:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833061.487847:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788833061.487852:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea26f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265864064:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.487904:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833061.487944:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863680 00000100:00100000:3.0:1788833061.487952:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863680 00000100:00100000:3.0:1788833061.488007:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788833061.488016:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265863680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488103:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265863680:12345-0@lo:400:kworker.0 Request processed in 77us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833061.488290:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788833061.488333:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864192 00000100:00100000:3.0:1788833061.488338:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864192 00000100:00100000:3.0:1788833061.488382:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863808 00000100:00100000:3.0:1788833061.488386:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863808 00000100:00100000:3.0:1788833061.488400:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265863936 00000100:00100000:3.0:1788833061.488402:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265863936 00000100:00100000:3.0:1788833061.488418:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788833061.488424:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265864192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488461:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265864192:12345-0@lo:400:kworker.0 Request processed in 37us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833061.488467:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788833061.488480:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788833061.488486:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265863808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488515:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265863808:12345-0@lo:400:kworker.0 Request processed in 29us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833061.488532:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788833061.488545:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788833061.488551:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265863936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488584:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265863936:12345-0@lo:400:kworker.0 Request processed in 34us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833061.488590:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788833061.488611:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864320 00000100:00100000:3.0:1788833061.488615:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864320 00000100:00100000:3.0:1788833061.488642:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864064 00000100:00100000:3.0:1788833061.488645:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864064 00000100:00100000:3.0:1788833061.488665:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788833061.488671:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265864320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488703:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265864320:12345-0@lo:400:kworker.0 Request processed in 32us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833061.488708:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788833061.488720:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788833061.488726:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265864064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488757:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265864064:12345-0@lo:400:kworker.0 Request processed in 32us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833061.488763:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788833061.488787:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833061.488791:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833061.488794:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788833061.488825:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea26f5ea00 x1875727265864064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833061.488840:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265864064:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488876:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265863936:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488915:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265863808:0@lo:400:kworker.0 00010000:00080000:3.0:1788833061.488925:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea26f5ca80 x1875727265864320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833061.488933:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265864320:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488942:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265863680:0@lo:400:kworker.0 00000100:00100000:3.0:1788833061.488952:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265864192:0@lo:400:kworker.0 00000100:00100000:0.0:1788833061.582991:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833061.583069:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396032 00000100:00100000:0.0:1788833061.583082:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833061.583085:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396032 00000100:00100000:2.0:1788833061.583193:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:2.0:1788833061.583205:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256396032:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833061.583305:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256396032:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 102us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833061.583312:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:1.0:1788833061.583503:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256395904 00000100:00100000:1.0:1788833061.583508:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256395904 00000100:00100000:1.0:1788833061.583542:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 199 00000100:00100000:1.0:1788833061.583550:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2358:x1875727256395904:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833061.583581:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2358:x1875727256395904:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833061.583587:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 199 00000100:00080000:0.0:1788833061.583660:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788833061.878196:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833061.997258:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265864448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833061.997353:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833061.997574:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864448 00000100:00100000:2.0:1788833061.997584:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864448 00000100:00100000:2.0:1788833061.997656:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788833061.997667:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265864448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833061.997711:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833062.006167:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265864448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8487us (8799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833062.006191:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788833062.006296:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265864576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833062.006389:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833062.006810:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864576 00000100:00100000:1.0:1788833062.006831:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864576 00000100:00100000:1.0:1788833062.006899:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788833062.006911:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265864576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833062.006957:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833062.007015:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265864576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833062.007022:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788833062.007268:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb65880 x1875727265864576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833062.007295:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265864576:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788833062.008458:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fb66d80 x1875727265864448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833062.008481:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265864448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788833062.893433:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833063.921125:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833064.947458:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833065.968430:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833066.607446:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265864832:0@lo:400:kworker.0 00000100:00100000:1.0:1788833066.607548:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833066.607561:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265864704:0@lo:400:kworker.0 00000100:00100000:2.0:1788833066.607612:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833066.607652:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265865088:0@lo:400:kworker.0 00000100:00100000:2.0:1788833066.607682:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833066.607716:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864704 00000100:00100000:2.0:1788833066.607725:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864704 00000100:00100000:1.0:1788833066.607828:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265865344:0@lo:400:kworker.0 00000100:00100000:1.0:1788833066.607858:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833066.609387:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265864960:0@lo:400:kworker.0 00000100:00100000:0.0:1788833066.609396:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864832 00000100:00100000:0.0:1788833066.609408:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864832 00000100:00100000:0.0:1788833066.609472:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788833066.609485:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265864832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833066.609532:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833066.609594:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865088 00000100:00100000:1.0:1788833066.609599:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865088 00000100:00100000:1.0:1788833066.609761:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865344 00000100:00100000:1.0:1788833066.609766:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865344 00000100:00100000:1.0:1788833066.609788:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788833066.609796:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265865088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833066.609879:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265864832:12345-0@lo:400:kworker.0 Request processed in 395us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833066.609899:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788833066.609933:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265864960 00000100:00100000:0.0:1788833066.609937:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265864960 00000100:00100000:0.0:1788833066.609966:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788833066.609973:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265864960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833066.610129:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265865088:12345-0@lo:400:kworker.0 Request processed in 333us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833066.610136:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788833066.610151:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788833066.610158:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265865344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833066.610346:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788833066.610359:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265864704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833066.611154:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265865344:12345-0@lo:400:kworker.0 Request processed in 991us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833066.611164:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788833066.611199:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265864960:12345-0@lo:400:kworker.0 Request processed in 1223us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833066.611211:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788833066.611213:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788833066.611221:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833066.611224:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833066.611266:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265865216:0@lo:400:kworker.0 00010000:00080000:1.0:1788833066.611290:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902701880 x1875727265865088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833066.611309:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265865088:0@lo:400:kworker.0 00000100:00100000:0.0:1788833066.611317:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833066.611363:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865216 00000100:00100000:1.0:1788833066.611369:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865216 00000100:00100000:0.0:1788833066.611406:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265864832:0@lo:400:kworker.0 00010000:00080000:0.0:1788833066.611422:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902702d80 x1875727265865344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833066.611433:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265865344:0@lo:400:kworker.0 00000100:00100000:1.0:1788833066.611462:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788833066.611468:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833066.611473:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265865216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833066.611493:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265864960:0@lo:400:kworker.0 00000100:00100000:1.0:1788833066.611528:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265865216:12345-0@lo:400:kworker.0 Request processed in 58us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833066.611537:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788833066.611546:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265865216:0@lo:400:kworker.0 00000100:00100000:2.0:1788833066.615016:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265864704:12345-0@lo:400:kworker.0 Request processed in 4642us (7384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833066.615055:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788833066.615907:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265864704:0@lo:400:kworker.0 00000100:00100000:3.0:1788833066.701543:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833066.701614:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833066.701701:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396288 00000100:00100000:0.0:1788833066.701731:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396288 00000100:00080000:2.0:1788833066.701821:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833066.701825:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:0.0:1788833066.701836:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256396288:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833066.701947:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256396288:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 113us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833066.701973:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:1.0:1788833066.702602:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396160 00000100:00100000:1.0:1788833066.702611:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396160 00000100:00100000:1.0:1788833066.702669:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 201 00000100:00100000:1.0:1788833066.702679:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2359:x1875727256396160:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833066.702742:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2359:x1875727256396160:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 65us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833066.702749:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 201 00010000:00010000:2.0:1788833066.990219:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833067.118172:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265865472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833067.118238:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833067.118311:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865472 00000100:00100000:1.0:1788833067.118319:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865472 00000100:00100000:1.0:1788833067.118372:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788833067.118382:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265865472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833067.118417:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833067.118464:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265865472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833067.118472:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788833067.118510:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40ea00 x1875727265865472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833067.118549:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265865472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833067.119509:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833067.119521:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265865600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833067.119562:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833067.119603:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865600 00000100:00100000:1.0:1788833067.119608:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865600 00000100:00100000:1.0:1788833067.119642:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788833067.119650:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265865600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833067.119673:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833067.119707:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265865600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833067.119713:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788833067.119744:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40ea00 x1875727265865600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833067.119759:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265865600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788833068.018518:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833069.044406:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833070.063107:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833071.085639:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833071.727457:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265866112:0@lo:400:kworker.0 00000100:00100000:1.0:1788833071.727556:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833071.727645:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833071.727652:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265865984:0@lo:400:kworker.0 00000100:00100000:1.0:1788833071.727682:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833071.727721:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265866112 00000100:00100000:1.0:1788833071.727730:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265866112 00000100:00100000:2.0:1788833071.727771:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265865856:0@lo:400:kworker.0 00000100:00100000:1.0:1788833071.727802:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788833071.727812:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833071.727834:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265866112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833071.727842:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265866368:0@lo:400:kworker.0 00000100:00100000:2.0:1788833071.727874:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833071.727903:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788833071.727909:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265866112:12345-0@lo:400:kworker.0 Request processed in 78us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833071.727912:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265865728:0@lo:400:kworker.0 00000100:00100000:1.0:1788833071.727922:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788833071.727943:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265866368 00000100:00100000:1.0:1788833071.727947:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265866368 00000100:00100000:2.0:1788833071.727951:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833071.727978:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265866240:0@lo:400:kworker.0 00000100:00100000:1.0:1788833071.727997:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788833071.728002:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833071.728007:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265866368:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788833071.728066:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833071.728073:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833071.728089:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265866368:12345-0@lo:400:kworker.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833071.728090:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865984 00000100:00100000:1.0:1788833071.728096:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788833071.728103:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865984 00000100:00100000:1.0:1788833071.728121:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865856 00000100:00100000:1.0:1788833071.728126:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865856 00000100:00100000:2.0:1788833071.728153:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265866240 00000100:00100000:1.0:1788833071.728157:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788833071.728158:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265866240 00000100:00100000:1.0:1788833071.728166:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265865984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833071.728185:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788833071.728193:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265865856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833071.728207:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265865984:12345-0@lo:400:kworker.0 Request processed in 41us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833071.728215:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788833071.728234:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788833071.728239:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265865856:12345-0@lo:400:kworker.0 Request processed in 44us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833071.728246:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265866240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833071.728250:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788833071.728283:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265865728 00000100:00100000:2.0:1788833071.728287:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265865728 00000100:00100000:1.0:1788833071.728290:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265866240:12345-0@lo:400:kworker.0 Request processed in 46us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833071.728298:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788833071.728320:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788833071.728330:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265865728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833071.728353:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265865984:0@lo:400:kworker.0 00000100:00100000:2.0:1788833071.728367:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265865728:12345-0@lo:400:kworker.0 Request processed in 38us (417us total) trans 0 rc 0/0 00010000:00080000:1.0:1788833071.728375:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40c000 x1875727265866112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833071.728376:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788833071.728403:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265866112:0@lo:400:kworker.0 00000100:00080000:2.0:1788833071.728414:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833071.728436:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265865728:0@lo:400:kworker.0 00000100:00100000:2.0:1788833071.728447:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265866240:0@lo:400:kworker.0 00000100:00100000:2.0:1788833071.728458:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265865856:0@lo:400:kworker.0 00010000:00080000:2.0:1788833071.728467:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40c380 x1875727265866368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833071.728477:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265866368:0@lo:400:kworker.0 00000100:00100000:3.0:1788833071.831074:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833071.831127:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833071.831163:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396416 00000100:00100000:3.0:1788833071.831176:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396416 00000100:00100000:3.0:1788833071.831235:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 203 00000100:00100000:3.0:1788833071.831246:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2360:x1875727256396416:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833071.831333:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2360:x1875727256396416:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833071.831348:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 203 00000100:00100000:2.0:1788833071.831467:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396544 00000100:00100000:2.0:1788833071.831472:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396544 00000100:00100000:2.0:1788833071.831532:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:2.0:1788833071.831541:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256396544:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833071.831584:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256396544:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 45us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833071.831592:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00080000:2.0:1788833071.831755:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788833072.109622:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833072.238264:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265866496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833072.238360:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833072.238436:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833072.238443:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265866624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833072.238493:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833072.238775:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265866496 00000100:00100000:1.0:1788833072.238785:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265866496 00000100:00100000:1.0:1788833072.238829:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265866624 00000100:00100000:1.0:1788833072.238831:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265866624 00000100:00100000:1.0:1788833072.238848:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788833072.238857:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265866496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833072.238905:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833072.238963:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265866496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833072.238972:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788833072.238991:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788833072.238998:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265866624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833072.239021:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833072.239093:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265866624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833072.239099:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788833072.239147:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40ce00 x1875727265866624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833072.239173:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265866624:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788833072.239198:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40c000 x1875727265866496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833072.239210:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265866496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788833073.140362:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833074.159068:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788833075.176267:0:10086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:04:33 (1788833073) === 00010000:00010000:2.0:1788833075.182283:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833075.723011:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833075.723173:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396672 00000100:00100000:2.0:1788833075.723200:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396672 00000100:00100000:2.0:1788833075.723283:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 204 00000100:00100000:2.0:1788833075.723296:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:8129:x1875727256396672:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788833075.723315:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833075.723335:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fea50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72adab expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833075.723364:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fea50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72adab expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833075.723376:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fea50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72adab expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833075.723385:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517e00, rc 0) 00000100:00100000:2.0:1788833075.723452:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8129:x1875727256396672:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 159us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833075.723459:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 204 00000100:00100000:2.0:1788833075.725856:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833075.725986:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396800 00000100:00100000:0.0:1788833075.725995:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396800 00000100:00100000:0.0:1788833075.726090:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 205 00000100:00100000:0.0:1788833075.726101:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8129:x1875727256396800:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788833075.726410:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8129:x1875727256396800:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 310us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833075.726418:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 205 00000100:00100000:3.0:1788833075.738568:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833075.742608:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256396928 00000100:00100000:2.0:1788833075.742624:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256396928 00000100:00100000:2.0:1788833075.742705:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 206 00000100:00100000:2.0:1788833075.742716:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8129:x1875727256396928:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788833075.742958:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8129:x1875727256396928:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 243us (4403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833075.742967:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 206 00000100:00100000:2.0:1788833075.747656:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833075.751720:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397056 00000100:00100000:0.0:1788833075.751738:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397056 00000100:00100000:0.0:1788833075.751884:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 207 00000100:00100000:0.0:1788833075.751896:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8133:x1875727256397056:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833075.752618:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8133:x1875727256397056:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 721us (4969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833075.752627:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 207 00000100:00100000:1.0:1788833075.789097:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833075.789215:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397184 00000100:00100000:3.0:1788833075.789239:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397184 00000100:00100000:3.0:1788833075.789386:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 208 00000100:00100000:3.0:1788833075.789402:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8133:x1875727256397184:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788833075.789799:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8133:x1875727256397184:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 400us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833075.789809:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 208 00000100:00100000:2.0:1788833075.805450:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833075.805582:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397312 00000100:00100000:0.0:1788833075.805591:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397312 00000100:00100000:0.0:1788833075.805643:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 209 00000100:00100000:0.0:1788833075.805655:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:8129:x1875727256397312:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788833075.805670:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833075.805686:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32477000/0x8c08e876ed3fea57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72add5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833075.805714:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477000/0x8c08e876ed3fea57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72add5 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833075.805738:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32477000/0x8c08e876ed3fea57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72add5 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833075.805747:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477000, rc 0) 00000100:00100000:0.0:1788833075.805800:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:8129:x1875727256397312:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 149us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833075.805807:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 209 00000100:00100000:0.0:1788833075.817243:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833075.817412:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397440 00000100:00100000:3.0:1788833075.817423:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397440 00000100:00100000:3.0:1788833075.817483:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 210 00000100:00100000:3.0:1788833075.817494:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:8129:x1875727256397440:12345-192.168.206.55@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788833075.817521:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788833075.817550:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788833075.817555:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788833075.817558:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788833075.817561:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788833075.821298:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:8129:x1875727256397440:12345-192.168.206.55@tcp:256:mount.lustre.0 Request processed in 3787us (4048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833075.821316:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 210 00000100:00100000:2.0:1788833075.838642:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833075.841718:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397568 00000100:00100000:1.0:1788833075.841740:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397568 00000100:00100000:1.0:1788833075.841841:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 211 00000100:00100000:1.0:1788833075.841854:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:8129:x1875727256397568:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788833075.841875:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833075.841902:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72addc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833075.841944:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833075.841958:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833075.841968:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fc00, rc 0) 00000100:00100000:1.0:1788833075.842096:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8129:x1875727256397568:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 244us (4661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833075.842104:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 211 00000100:00100000:0.0:1788833075.846184:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833075.847006:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397696 00000100:00100000:3.0:1788833075.847076:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397696 00000100:00100000:3.0:1788833075.847166:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 212 00000100:00100000:3.0:1788833075.847180:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8129:x1875727256397696:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788833075.849427:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8129:x1875727256397696:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 2230us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833075.849450:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 212 00000100:00100000:2.0:1788833075.854853:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833075.854971:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397824 00000100:00100000:0.0:1788833075.854984:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397824 00000100:00100000:0.0:1788833075.855101:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 213 00000100:00100000:0.0:1788833075.855114:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8129:x1875727256397824:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788833075.855561:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8129:x1875727256397824:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 447us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833075.855571:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 213 00000100:00100000:2.0:1788833075.860142:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833075.860238:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256397952 00000100:00100000:1.0:1788833075.860247:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256397952 00000100:00100000:1.0:1788833075.860296:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 214 00000100:00100000:1.0:1788833075.860305:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8135:x1875727256397952:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833075.860565:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8135:x1875727256397952:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 260us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833075.860573:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 214 00000100:00100000:2.0:1788833075.863381:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833075.863632:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398080 00000100:00100000:0.0:1788833075.863644:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398080 00000100:00100000:0.0:1788833075.863708:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 215 00000100:00100000:0.0:1788833075.863719:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8135:x1875727256398080:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833075.864295:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:8135:x1875727256398080:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 574us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833075.864305:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 215 00000100:00100000:2.0:1788833075.882731:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833075.884608:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398208 00000100:00100000:3.0:1788833075.884622:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398208 00000100:00100000:3.0:1788833075.884665:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:3.0:1788833075.884673:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1875727256398208:12345-192.168.206.55@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788833075.884702:0:5812:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 95db0428-be24-4f30-b1d9-80f4991cba8f@192.168.206.55@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1788833075.884750:0:5812:0:(genops.c:1385:class_connect()) connect: client 95db0428-be24-4f30-b1d9-80f4991cba8f, cookie 0x8c08e876ed3fea65 00000004:00100000:3.0:1788833075.884780:0:5812:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788833075.885362:0:5812:0:(import.c:65:import_set_state_nolock()) ffff9cea1f41d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833075.885434:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2356:x1875727256398208:12345-192.168.206.55@tcp:38:mount.lustre.0 Request processed in 759us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833075.885443:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:0.0:1788833075.885556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833075.886184:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398336 00000100:00100000:1.0:1788833075.886193:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398336 00000100:00100000:1.0:1788833075.886253:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:1.0:1788833075.886265:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256398336:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833075.886314:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256398336:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 53us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833075.886321:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00080000:3.0:1788833075.886438:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833075.895216:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833075.895354:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833075.895455:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398464 00000100:00100000:2.0:1788833075.895465:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398464 00000100:00100000:2.0:1788833075.895535:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398592 00000100:00100000:2.0:1788833075.895539:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398592 00000100:00100000:2.0:1788833075.895560:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:2.0:1788833075.895570:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+7:0:x1875727256398464:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788833075.895614:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788833075.895696:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+7:0:x1875727256398464:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 126us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833075.895704:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:2.0:1788833075.895722:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:2.0:1788833075.895729:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:8129:x1875727256398592:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788833075.895741:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788833075.895764:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:8129:x1875727256398592:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 36us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833075.895778:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00080000:0.0:1788833075.896316:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833075.898329:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833075.898428:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398720 00000100:00100000:0.0:1788833075.898437:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398720 00000100:00100000:0.0:1788833075.898494:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:0.0:1788833075.898504:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:8129:x1875727256398720:12345-192.168.206.55@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788833075.898597:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:8129:x1875727256398720:12345-192.168.206.55@tcp:40:mount.lustre.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833075.898604:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:2.0:1788833075.904152:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833075.904197:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833075.904250:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833075.904347:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256399104 00000100:00100000:3.0:1788833075.904357:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256399104 00000100:00100000:3.0:1788833075.904418:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:3.0:1788833075.904429:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:8129:x1875727256399104:12345-192.168.206.55@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788833075.904511:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788833075.904593:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:8129:x1875727256399104:12345-192.168.206.55@tcp:33:mount.lustre.0 Request processed in 166us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833075.904601:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:1.0:1788833075.904676:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398848 00000100:00100000:1.0:1788833075.904680:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398848 00000100:00100000:1.0:1788833075.904719:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256398976 00000100:00100000:1.0:1788833075.904722:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256398976 00000100:00100000:1.0:1788833075.904737:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:1.0:1788833075.904743:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875727256398848:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788833075.904763:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 95db0428-be24-4f30-b1d9-80f4991cba8f@192.168.206.55@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1788833075.904790:0:8426:0:(genops.c:1385:class_connect()) connect: client 95db0428-be24-4f30-b1d9-80f4991cba8f, cookie 0x8c08e876ed3fea6c 00002000:00100000:1.0:1788833075.904799:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95db0428-be24-4f30-b1d9-80f4991cba8f/ffff9cea3f4b0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788833075.904821:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788833075.905072:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788833075.905098:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9cea3f4b1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833075.905125:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2356:x1875727256398848:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 381us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833075.905132:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:1.0:1788833075.905154:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:1.0:1788833075.905158:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875727256398976:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788833075.905174:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 95db0428-be24-4f30-b1d9-80f4991cba8f@192.168.206.55@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1788833075.905188:0:8426:0:(genops.c:1385:class_connect()) connect: client 95db0428-be24-4f30-b1d9-80f4991cba8f, cookie 0x8c08e876ed3fea73 00002000:00100000:1.0:1788833075.905193:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95db0428-be24-4f30-b1d9-80f4991cba8f/ffff9cea3f4b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788833075.905206:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788833075.905308:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788833075.905322:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9cea3f4b2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833075.905342:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2356:x1875727256398976:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 182us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833075.905348:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00010000:00010000:2.0:1788833076.205238:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788833076.427619:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95db0428-be24-4f30-b1d9-80f4991cba8f 00000001:00100000:3.0:1788833076.444558:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95db0428-be24-4f30-b1d9-80f4991cba8f 00000100:00100000:3.0:1788833076.845951:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265867136:0@lo:400:kworker.0 00000100:00100000:3.0:1788833076.846069:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833076.846138:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788833076.846145:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265867008:0@lo:400:kworker.0 00000100:00100000:3.0:1788833076.846171:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833076.846199:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867136 00000100:00100000:3.0:1788833076.846206:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867136 00000100:00100000:3.0:1788833076.846257:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788833076.846267:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265867136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833076.846316:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265867136:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833076.846324:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788833076.846522:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265866880:0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.846551:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833076.846572:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265867392:0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.846592:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833076.846609:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788833076.846614:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265866752:0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.846640:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833076.846661:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265867264:0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.846682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833076.846706:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867008 00000100:00100000:2.0:1788833076.846710:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867008 00000100:00100000:2.0:1788833076.846738:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265866880 00000100:00100000:2.0:1788833076.846741:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265866880 00000100:00100000:2.0:1788833076.846754:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867264 00000100:00100000:2.0:1788833076.846756:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867264 00000100:00100000:2.0:1788833076.846769:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788833076.846775:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265867008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.846806:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265867008:12345-0@lo:400:kworker.0 Request processed in 31us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833076.846824:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788833076.846839:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788833076.846845:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265866880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.846876:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265866880:12345-0@lo:400:kworker.0 Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833076.846882:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788833076.846893:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788833076.846899:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265867264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.846925:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265867264:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833076.846931:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788833076.846947:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867392 00000100:00100000:2.0:1788833076.846951:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867392 00000100:00100000:2.0:1788833076.846974:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788833076.846980:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265867392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.847057:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265867392:12345-0@lo:400:kworker.0 Request processed in 50us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833076.847064:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788833076.847100:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265867264:0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.847111:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265866880:0@lo:400:kworker.0 00010000:00080000:2.0:1788833076.847122:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8380 x1875727265867392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833076.847131:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265867392:0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.847172:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265866752 00000100:00100000:2.0:1788833076.847181:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265866752 00000100:00100000:2.0:1788833076.847209:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788833076.847216:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265866752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833076.847250:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265866752:12345-0@lo:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833076.847256:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788833076.847287:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265866752:0@lo:400:kworker.0 00010000:00080000:3.0:1788833076.847657:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8000 x1875727265867136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833076.847669:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265867136:0@lo:400:kworker.0 00000100:00100000:3.0:1788833076.847691:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265867008:0@lo:400:kworker.0 00000100:00080000:0.0:1788833076.849425:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788833076.849433:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788833076.849436:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788833077.235499:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833077.362702:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265867520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833077.362764:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833077.362838:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867520 00000100:00100000:1.0:1788833077.362845:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867520 00000100:00100000:1.0:1788833077.362889:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788833077.362912:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265867520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833077.362946:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833077.362988:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265867520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833077.362995:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788833077.363057:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40c000 x1875727265867520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833077.363073:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265867520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833077.363956:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265867648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833077.363999:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833077.364068:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867648 00000100:00100000:0.0:1788833077.364074:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867648 00000100:00100000:0.0:1788833077.364106:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788833077.364115:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265867648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833077.364141:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833077.364179:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265867648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833077.364185:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788833077.364218:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea396c1f80 x1875727265867648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833077.364233:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265867648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788833078.254180:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833079.281280:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788833080.009275:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95db0428-be24-4f30-b1d9-80f4991cba8f 00010000:00010000:3.0:1788833080.301822:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833081.042553:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833081.042598:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833081.042632:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833081.042671:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833081.042699:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833081.042895:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256399232 00000100:00100000:0.0:1788833081.042905:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256399232 00000100:00100000:0.0:1788833081.042965:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 217 00000100:00100000:0.0:1788833081.042975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256399232:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833081.043076:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256399232:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 102us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833081.043083:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 217 00000100:00100000:2.0:1788833081.043178:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256399360 00000100:00100000:2.0:1788833081.043182:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256399360 00000100:00100000:2.0:1788833081.043228:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256399488 00000100:00100000:2.0:1788833081.043232:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256399488 00000100:00100000:2.0:1788833081.043269:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:2.0:1788833081.043278:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256399360:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833081.043311:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256399360:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 35us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.043317:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:2.0:1788833081.043330:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:2.0:1788833081.043335:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256399488:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833081.043355:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256399488:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 21us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.043362:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:2.0:1788833081.043382:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256399616 00000100:00100000:2.0:1788833081.043386:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256399616 00000100:00100000:2.0:1788833081.043415:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256399744 00000100:00100000:2.0:1788833081.043427:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256399744 00000100:00100000:2.0:1788833081.043454:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:2.0:1788833081.043460:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256399616:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833081.043487:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256399616:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 27us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.043493:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:2.0:1788833081.043505:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:2.0:1788833081.043511:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256399744:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833081.043533:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256399744:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 22us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.043554:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00080000:0.0:1788833081.044266:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788833081.044271:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788833081.044274:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788833081.326567:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833081.965436:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265868032:0@lo:400:kworker.0 00000100:00100000:1.0:1788833081.965532:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833081.965625:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833081.965631:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265868160:0@lo:400:kworker.0 00000100:00100000:1.0:1788833081.965662:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833081.965680:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868032 00000100:00100000:0.0:1788833081.965690:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868032 00000100:00100000:1.0:1788833081.965695:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868160 00000100:00100000:1.0:1788833081.965699:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868160 00000100:00100000:3.0:1788833081.965757:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265867904:0@lo:400:kworker.0 00000100:00100000:3.0:1788833081.965791:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833081.965813:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265868416:0@lo:400:kworker.0 00000100:00100000:3.0:1788833081.965835:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833081.965855:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788833081.965861:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265867776:0@lo:400:kworker.0 00000100:00100000:3.0:1788833081.965889:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833081.965923:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265868288:0@lo:400:kworker.0 00000100:00100000:0.0:1788833081.965923:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867904 00000100:00100000:0.0:1788833081.965927:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867904 00000100:00100000:3.0:1788833081.965954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833081.965981:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868288 00000100:00100000:3.0:1788833081.965985:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868288 00000100:00100000:2.0:1788833081.966068:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788833081.966082:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265868032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833081.966145:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265868032:12345-0@lo:400:kworker.0 Request processed in 67us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.966154:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788833081.966190:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265867776 00000100:00100000:2.0:1788833081.966194:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265867776 00000100:00100000:2.0:1788833081.966223:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788833081.966229:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265867776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833081.966265:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265867776:12345-0@lo:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.966272:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788833081.966305:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868416 00000100:00100000:2.0:1788833081.966316:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868416 00000100:00100000:1.0:1788833081.966335:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788833081.966340:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788833081.966342:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265868160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833081.966345:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265868416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833081.966375:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265868416:12345-0@lo:400:kworker.0 Request processed in 30us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.966382:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788833081.966384:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265868160:12345-0@lo:400:kworker.0 Request processed in 43us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833081.966390:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788833081.966431:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40f100 x1875727265868160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833081.966445:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265868160:0@lo:400:kworker.0 00000100:00100000:0.0:1788833081.966466:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788833081.966474:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265867904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833081.966516:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265867776:0@lo:400:kworker.0 00010000:00080000:2.0:1788833081.966529:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40ea00 x1875727265868416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833081.966547:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265868416:0@lo:400:kworker.0 00000100:00080000:2.0:1788833081.966615:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833081.966619:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833081.966622:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833081.968253:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833081.968269:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265868288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833081.968391:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265868288:12345-0@lo:400:kworker.0 Request processed in 127us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833081.968399:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833081.968459:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265868288:0@lo:400:kworker.0 00000100:00100000:1.0:1788833081.968968:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265868032:0@lo:400:kworker.0 00000100:00100000:0.0:1788833081.971866:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265867904:12345-0@lo:400:kworker.0 Request processed in 5378us (6058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833081.971886:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788833081.972209:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265867904:0@lo:400:kworker.0 00010000:00010000:2.0:1788833082.361430:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833082.477240:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788833082.477278:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265868544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833082.477378:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833082.477531:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868544 00000100:00100000:1.0:1788833082.477541:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868544 00000100:00100000:1.0:1788833082.477607:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788833082.477626:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265868544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833082.477671:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833082.477728:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265868544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833082.477736:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788833082.477784:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902702d80 x1875727265868544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833082.477806:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265868544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833082.479216:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833082.479236:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265868672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833082.479297:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833082.479354:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868672 00000100:00100000:1.0:1788833082.479361:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868672 00000100:00100000:1.0:1788833082.481027:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788833082.481066:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265868672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833082.481116:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833082.481208:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265868672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833082.481216:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788833082.481278:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902702d80 x1875727265868672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833082.481302:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265868672:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788833082.831787:0:10285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788833083.376383:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833084.402195:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833085.422324:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833086.162086:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833086.162131:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833086.162161:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833086.162186:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833086.162211:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833086.162262:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400000 00000100:00100000:2.0:1788833086.162273:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400000 00000100:00100000:2.0:1788833086.162796:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400128 00000100:00100000:2.0:1788833086.162803:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400128 00000100:00080000:0.0:1788833086.162919:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833086.163084:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:2.0:1788833086.163095:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256400000:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833086.163193:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256400000:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 100us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833086.163202:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:2.0:1788833086.163221:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:2.0:1788833086.163228:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256400128:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833086.163253:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256400128:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 25us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833086.163259:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:2.0:1788833086.163280:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256399872 00000100:00100000:2.0:1788833086.163284:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256399872 00000100:00100000:2.0:1788833086.163311:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 219 00000100:00100000:2.0:1788833086.163317:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256399872:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833086.163340:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256399872:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 23us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833086.163346:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 219 00000100:00100000:2.0:1788833086.163378:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400256 00000100:00100000:2.0:1788833086.163382:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400256 00000100:00100000:2.0:1788833086.163407:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400384 00000100:00100000:2.0:1788833086.163410:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400384 00000100:00080000:0.0:1788833086.163511:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788833086.163514:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833086.164534:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:2.0:1788833086.164544:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256400256:12345-192.168.206.55@tcp:400:kworker.0 00000100:00080000:0.0:1788833086.164679:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833086.164781:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256400256:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 238us (2594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833086.164790:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:2.0:1788833086.164906:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:2.0:1788833086.164998:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256400384:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833086.165145:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256400384:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 150us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833086.165153:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00010000:00010000:3.0:1788833086.446230:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833087.104197:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265868928:0@lo:400:kworker.0 00000100:00100000:3.0:1788833087.104214:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265869184:0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.104401:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265868800:0@lo:400:kworker.0 00000100:00100000:1.0:1788833087.105826:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833087.105894:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265869440:0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.105944:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833087.105954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833087.105984:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265869312:0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.106011:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833087.106014:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265869056:0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.106066:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868800 00000100:00100000:1.0:1788833087.106070:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833087.106075:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868800 00000100:00100000:1.0:1788833087.106110:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265868928 00000100:00100000:1.0:1788833087.106116:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265868928 00000100:00100000:2.0:1788833087.106121:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788833087.106131:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265868800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833087.106170:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869312 00000100:00100000:1.0:1788833087.106175:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869312 00000100:00100000:2.0:1788833087.106180:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265868800:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833087.106188:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788833087.106204:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869056 00000100:00100000:1.0:1788833087.106209:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869056 00000100:00100000:1.0:1788833087.106234:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788833087.106238:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869440 00000100:00100000:2.0:1788833087.106243:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869440 00000100:00100000:1.0:1788833087.106243:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265868928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.106280:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788833087.106288:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265869440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833087.106304:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265868928:12345-0@lo:400:kworker.0 Request processed in 62us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833087.106312:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788833087.106329:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788833087.106338:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265869312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.106341:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265869440:12345-0@lo:400:kworker.0 Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833087.106354:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788833087.106377:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788833087.106381:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265869312:12345-0@lo:400:kworker.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833087.106389:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265869056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833087.106395:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788833087.106421:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833087.106426:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833087.106428:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265869056:12345-0@lo:400:kworker.0 Request processed in 42us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833087.106435:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788833087.106458:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265869056:0@lo:400:kworker.0 00010000:00080000:1.0:1788833087.106505:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8380 x1875727265869440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833087.106529:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265869440:0@lo:400:kworker.0 00000100:00100000:1.0:1788833087.106546:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265868928:0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.106657:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265868800:0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.106670:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265869312:0@lo:400:kworker.0 00000100:00100000:3.0:1788833087.107699:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833087.107895:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869184 00000100:00100000:2.0:1788833087.107902:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869184 00000100:00100000:2.0:1788833087.107988:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788833087.107996:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265869184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833087.108058:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265869184:12345-0@lo:400:kworker.0 Request processed in 63us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833087.108064:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788833087.108099:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8a80 x1875727265869184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833087.108111:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265869184:0@lo:400:kworker.0 00000100:00080000:3.0:1788833087.108161:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788833087.477003:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833087.600507:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265869568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833087.600598:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833087.600693:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869568 00000100:00100000:2.0:1788833087.600702:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869568 00000100:00100000:2.0:1788833087.600747:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788833087.600757:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265869568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833087.600817:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833087.600870:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265869568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833087.600877:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788833087.600923:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1f40ca80 x1875727265869568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833087.600944:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265869568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833087.601269:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265869696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833087.601320:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833087.601354:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869696 00000100:00100000:0.0:1788833087.601358:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869696 00000100:00100000:0.0:1788833087.601395:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788833087.601401:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265869696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833087.601969:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833087.602062:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265869696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 660us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833087.602071:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788833087.602517:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea269c8e00 x1875727265869696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833087.602536:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265869696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788833088.493253:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833089.517196:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833090.552114:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833091.277211:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833091.277273:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833091.277296:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400512 00000100:00100000:2.0:1788833091.277308:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833091.277313:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400512 00000100:00100000:2.0:1788833091.277333:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833091.277396:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833091.277401:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 221 00000100:00100000:0.0:1788833091.277415:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256400512:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833091.277423:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401024 00000100:00100000:2.0:1788833091.277427:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401024 00000100:00100000:2.0:1788833091.277473:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400896 00000100:00100000:2.0:1788833091.277476:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400896 00000100:00100000:2.0:1788833091.277496:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:2.0:1788833091.277502:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256401024:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833091.277516:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256400512:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833091.277524:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 221 00000100:00100000:2.0:1788833091.277530:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256401024:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 30us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833091.277536:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:2.0:1788833091.277563:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:2.0:1788833091.277569:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40a7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256400896:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833091.277595:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40a7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256400896:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833091.277601:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:2.0:1788833091.277798:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400768 00000100:00100000:2.0:1788833091.277803:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400768 00000100:00100000:2.0:1788833091.277840:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256400640 00000100:00100000:2.0:1788833091.277843:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256400640 00000100:00100000:1.0:1788833091.277856:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:1.0:1788833091.277919:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256400768:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833091.277966:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256400768:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 101us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833091.278308:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:2.0:1788833091.278319:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256400640:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833091.278350:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256400640:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 34us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833091.278357:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00080000:2.0:1788833091.278390:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788833091.278396:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833091.278400:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788833091.286614:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 69 00010000:00010000:3.0:1788833091.569227:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833092.206792:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265870080:0@lo:400:kworker.0 00000100:00100000:3.0:1788833092.206875:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833092.206955:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788833092.206961:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265870208:0@lo:400:kworker.0 00000100:00100000:3.0:1788833092.206989:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833092.207051:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870080 00000100:00100000:3.0:1788833092.207060:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870080 00000100:00100000:3.0:1788833092.207123:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788833092.207134:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265870080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833092.207187:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265870080:12345-0@lo:400:kworker.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833092.207194:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788833092.207218:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870208 00000100:00100000:3.0:1788833092.207221:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870208 00000100:00100000:3.0:1788833092.207260:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788833092.207266:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265870208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833092.207295:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265870208:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833092.207301:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788833092.207316:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833092.207321:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788833092.207352:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8000 x1875727265870208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833092.207367:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265870208:0@lo:400:kworker.0 00000100:00100000:3.0:1788833092.207378:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265870080:0@lo:400:kworker.0 00000100:00100000:1.0:1788833092.207920:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265869824:0@lo:400:kworker.0 00000100:00100000:1.0:1788833092.207983:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833092.208024:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265870336:0@lo:400:kworker.0 00000100:00100000:1.0:1788833092.208083:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833092.208103:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788833092.208109:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265869952:0@lo:400:kworker.0 00000100:00100000:1.0:1788833092.208132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833092.208153:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265870464:0@lo:400:kworker.0 00000100:00100000:1.0:1788833092.208178:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833092.208213:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870336 00000100:00100000:1.0:1788833092.208219:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870336 00000100:00100000:1.0:1788833092.208258:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869952 00000100:00100000:1.0:1788833092.208261:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869952 00000100:00100000:1.0:1788833092.208280:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788833092.208287:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265870336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833092.208352:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265870336:12345-0@lo:400:kworker.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833092.208371:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788833092.208493:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788833092.208504:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265869952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833092.208543:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265869952:12345-0@lo:400:kworker.0 Request processed in 42us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833092.208549:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788833092.208584:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870464 00000100:00100000:0.0:1788833092.208588:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870464 00000100:00100000:0.0:1788833092.208621:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788833092.208628:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265870464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833092.208659:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265870464:12345-0@lo:400:kworker.0 Request processed in 32us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833092.208676:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788833092.208732:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265869952:0@lo:400:kworker.0 00010000:00080000:0.0:1788833092.208745:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8a80 x1875727265870464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833092.208755:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265870464:0@lo:400:kworker.0 00000100:00100000:0.0:1788833092.208765:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265870336:0@lo:400:kworker.0 00000100:00100000:3.0:1788833092.212129:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265869824 00000100:00100000:3.0:1788833092.212148:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265869824 00000100:00100000:3.0:1788833092.212226:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788833092.212240:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265869824:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788833092.212322:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833092.212330:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833092.212364:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265869824:12345-0@lo:400:kworker.0 Request processed in 127us (4380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833092.212371:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788833092.212383:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265869824:0@lo:400:kworker.0 00010000:00010000:3.0:1788833092.589402:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833092.717325:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788833092.717349:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265870592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833092.717438:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833092.717513:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870592 00000100:00100000:2.0:1788833092.717521:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870592 00000100:00100000:2.0:1788833092.717568:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788833092.717577:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265870592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833092.717624:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833092.717676:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265870592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833092.717684:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788833092.717724:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea066cca80 x1875727265870592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833092.717744:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265870592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833092.717775:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265870720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833092.717813:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833092.717853:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870720 00000100:00100000:0.0:1788833092.717858:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870720 00000100:00100000:0.0:1788833092.717892:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788833092.717899:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265870720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833092.717918:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833092.717964:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265870720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833092.717971:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788833092.718086:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea269c9500 x1875727265870720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833092.718098:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265870720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788833093.614109:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833094.637167:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833095.662884:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833096.404689:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833096.404740:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833096.404763:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833096.404793:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833096.405238:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401152 00000100:00100000:3.0:1788833096.405254:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401152 00000100:00100000:1.0:1788833096.405382:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401408 00000100:00100000:1.0:1788833096.405388:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401408 00000100:00100000:1.0:1788833096.405446:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401280 00000100:00100000:1.0:1788833096.405450:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401280 00000100:00100000:1.0:1788833096.405494:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:1.0:1788833096.405506:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256401408:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833096.405605:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256401408:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 101us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833096.405614:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:1.0:1788833096.405633:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:1.0:1788833096.405640:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256401280:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833096.405666:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256401280:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 27us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833096.405673:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00080000:2.0:1788833096.405941:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833096.406925:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833096.412629:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 223 00000100:00100000:3.0:1788833096.412675:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256401152:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833096.412825:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256401152:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 179us (8148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833096.412843:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 223 00000100:00100000:0.0:1788833096.415726:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401536 00000100:00100000:0.0:1788833096.415747:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401536 00000100:00100000:0.0:1788833096.416059:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401664 00000100:00100000:0.0:1788833096.416065:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401664 00000100:00100000:0.0:1788833096.416110:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:0.0:1788833096.416122:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2356:x1875727256401536:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:0.0:1788833096.416158:0:6654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fea6c 00000100:00080000:0.0:1788833096.416169:0:6654:0:(import.c:65:import_set_state_nolock()) ffff9cea3f4b1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788833096.416227:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788833096.416324:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:2.0:1788833096.416338:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2356:x1875727256401664:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:2.0:1788833096.416356:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fea73 00000100:00080000:2.0:1788833096.416375:0:6656:0:(import.c:65:import_set_state_nolock()) ffff9cea3f4b2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788833096.416418:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788833096.416774:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+2:2356:x1875727256401664:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 438us (9862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833096.416784:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:0.0:1788833096.417265:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+2:2356:x1875727256401536:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 1135us (12459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833096.417280:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00010000:00010000:0.0:1788833096.417365:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788833096.417520:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788833096.417527:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788833096.417780:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833096.692858:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788833096.845466:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95db0428-be24-4f30-b1d9-80f4991cba8f 00000020:00000080:3.0:1788833096.845474:0:7611:0:(genops.c:885:class_export_put()) final put ffff9cea3f4b4800/95db0428-be24-4f30-b1d9-80f4991cba8f 00000020:00000080:1.0:1788833096.845588:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f4b4800/95db0428-be24-4f30-b1d9-80f4991cba8f for lustre-OST0001 00000020:00000080:1.0:1788833096.845637:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3f4b2000 for lustre-OST0001 00000100:00100000:3.0:1788833097.325271:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265871104:0@lo:400:kworker.0 00000100:00100000:3.0:1788833097.325339:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833097.325392:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788833097.325398:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265871232:0@lo:400:kworker.0 00000100:00100000:3.0:1788833097.325436:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833097.325478:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265871104 00000100:00100000:3.0:1788833097.325486:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265871104 00000100:00100000:2.0:1788833097.325521:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265870848:0@lo:400:kworker.0 00000100:00100000:3.0:1788833097.325544:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788833097.325561:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833097.325567:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265871104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.325611:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265871360:0@lo:400:kworker.0 00000100:00100000:3.0:1788833097.325642:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265871104:12345-0@lo:400:kworker.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833097.325651:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788833097.325657:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833097.325689:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788833097.325695:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265870976:0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.325719:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833097.335270:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265871360 00000100:00100000:3.0:1788833097.335287:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265871360 00000100:00100000:2.0:1788833097.335317:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265871488:0@lo:400:kworker.0 00000100:00100000:3.0:1788833097.335346:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870976 00000100:00100000:3.0:1788833097.335350:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870976 00000100:00100000:3.0:1788833097.335370:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788833097.335380:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265871360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.335568:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833097.335753:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788833097.335762:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265870976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.335802:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265870976:12345-0@lo:400:kworker.0 Request processed in 41us (10082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833097.335809:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788833097.335896:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265871232 00000100:00100000:2.0:1788833097.335901:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265871232 00000100:00100000:2.0:1788833097.335943:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265871488 00000100:00100000:2.0:1788833097.335946:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265871488 00000100:00100000:2.0:1788833097.335971:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788833097.335978:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265871232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.336013:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265871232:12345-0@lo:400:kworker.0 Request processed in 36us (10589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833097.336020:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788833097.336057:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788833097.336065:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265871488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.336095:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265871488:12345-0@lo:400:kworker.0 Request processed in 32us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833097.336101:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788833097.336151:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265870976:0@lo:400:kworker.0 00010000:00080000:2.0:1788833097.336165:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8700 x1875727265871488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833097.336176:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265871488:0@lo:400:kworker.0 00000100:00080000:2.0:1788833097.336231:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833097.336236:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833097.336238:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833097.336263:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265870848 00000100:00100000:2.0:1788833097.336267:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265870848 00000100:00100000:2.0:1788833097.336295:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788833097.336303:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265870848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.336568:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265870848:12345-0@lo:400:kworker.0 Request processed in 265us (11006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833097.336576:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00010000:00080000:2.0:1788833097.336782:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a8380 x1875727265871232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833097.336795:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265871232:0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.336807:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265871104:0@lo:400:kworker.0 00000100:00100000:2.0:1788833097.336964:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265870848:0@lo:400:kworker.0 00000100:00100000:3.0:1788833097.338732:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265871360:12345-0@lo:400:kworker.0 Request processed in 3346us (13068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833097.338745:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788833097.340794:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265871360:0@lo:400:kworker.0 00010000:00010000:1.0:1788833097.713164:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833097.837421:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265871616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833097.837487:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833097.837559:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265871616 00000100:00100000:1.0:1788833097.837567:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265871616 00000100:00100000:1.0:1788833097.837615:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788833097.837624:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265871616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833097.837668:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833097.837713:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265871616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833097.837720:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788833097.837759:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea39579500 x1875727265871616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833097.837775:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265871616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833097.838986:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265871744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833097.839072:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833097.839208:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265871744 00000100:00100000:3.0:1788833097.839227:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265871744 00000100:00100000:3.0:1788833097.839276:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788833097.839285:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265871744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833097.839313:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833097.839357:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265871744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833097.839363:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788833097.839635:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a9f80 x1875727265871744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833097.839656:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265871744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788833098.734060:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833099.757634:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788833099.946991:0:10985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788833100.453574:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95db0428-be24-4f30-b1d9-80f4991cba8f 00000020:00000080:0.0:1788833100.453583:0:6679:0:(genops.c:885:class_export_put()) final put ffff9cea3f4b0000/95db0428-be24-4f30-b1d9-80f4991cba8f 00000020:00000080:2.0:1788833100.453647:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f4b0000/95db0428-be24-4f30-b1d9-80f4991cba8f for lustre-OST0000 00000020:00000080:2.0:1788833100.453695:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3f4b1000 for lustre-OST0000 00010000:00010000:1.0:1788833100.786472:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833101.528222:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833101.528252:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833101.528295:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833101.528626:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402048 00000100:00100000:2.0:1788833101.528636:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402048 00000100:00100000:2.0:1788833101.528689:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401920 00000100:00100000:2.0:1788833101.528692:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401920 00000100:00100000:2.0:1788833101.528749:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:2.0:1788833101.528759:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256402048:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833101.528828:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256402048:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 71us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833101.528835:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:2.0:1788833101.528852:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:2.0:1788833101.528858:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256401920:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833101.528881:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256401920:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 24us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833101.528899:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00080000:2.0:1788833101.528918:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833101.529565:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256401792 00000100:00100000:3.0:1788833101.529571:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256401792 00000100:00100000:3.0:1788833101.529623:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 225 00000100:00100000:3.0:1788833101.529633:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256401792:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833101.529672:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256401792:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 42us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833101.529677:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 225 00010000:00010000:0.0:1788833101.805295:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833102.451074:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265872128:0@lo:400:kworker.0 00000100:00100000:0.0:1788833102.451148:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833102.451208:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833102.451214:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265872256:0@lo:400:kworker.0 00000100:00100000:0.0:1788833102.451239:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833102.451340:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265872256 00000100:00100000:3.0:1788833102.451348:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265872256 00000100:00100000:0.0:1788833102.451364:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265872128 00000100:00100000:0.0:1788833102.451369:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265872128 00000100:00100000:2.0:1788833102.451431:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265871872:0@lo:400:kworker.0 00000100:00100000:3.0:1788833102.451445:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788833102.451461:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265872256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833102.451468:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833102.451497:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265872384:0@lo:400:kworker.0 00000100:00100000:3.0:1788833102.451524:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265872256:12345-0@lo:400:kworker.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833102.451532:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833102.451539:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788833102.451559:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788833102.451567:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265872000:0@lo:400:kworker.0 00000100:00100000:2.0:1788833102.451657:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833102.451684:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265872512:0@lo:400:kworker.0 00000100:00100000:2.0:1788833102.451702:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833102.451727:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265871872 00000100:00100000:2.0:1788833102.451731:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265871872 00000100:00100000:2.0:1788833102.451757:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788833102.451763:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265871872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833102.451796:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265871872:12345-0@lo:400:kworker.0 Request processed in 33us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833102.451810:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788833102.451853:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265872384 00000100:00100000:2.0:1788833102.451857:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265872384 00000100:00100000:0.0:1788833102.451918:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265872000 00000100:00100000:0.0:1788833102.451922:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265872000 00000100:00100000:0.0:1788833102.451937:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788833102.451943:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265872128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833102.451974:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265872128:12345-0@lo:400:kworker.0 Request processed in 32us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833102.451980:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788833102.452000:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788833102.452006:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265872000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833102.452060:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265872000:12345-0@lo:400:kworker.0 Request processed in 54us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833102.452067:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788833102.452088:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788833102.452094:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833102.452107:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265872512 00000100:00100000:3.0:1788833102.452111:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265872512 00000100:00100000:3.0:1788833102.452145:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788833102.452155:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265872512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833102.452204:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265872512:12345-0@lo:400:kworker.0 Request processed in 53us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833102.452210:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788833102.452322:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea396c2680 x1875727265872256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833102.452336:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265872256:0@lo:400:kworker.0 00000100:00100000:3.0:1788833102.452349:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265872128:0@lo:400:kworker.0 00000100:00080000:3.0:1788833102.452395:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833102.457369:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788833102.457384:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265872384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833102.457539:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265872384:12345-0@lo:400:kworker.0 Request processed in 159us (6009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833102.457546:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788833102.457659:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265872000:0@lo:400:kworker.0 00010000:00080000:2.0:1788833102.457685:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc44e00 x1875727265872512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833102.457694:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265872512:0@lo:400:kworker.0 00000100:00100000:2.0:1788833102.457703:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265871872:0@lo:400:kworker.0 00000100:00100000:2.0:1788833102.457711:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265872384:0@lo:400:kworker.0 00000100:00080000:3.0:1788833102.461169:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788833102.829460:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833102.957187:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788833102.957210:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265872640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833102.957283:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833102.957344:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3957a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265872768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833102.957367:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833102.957401:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265872640 00000100:00100000:1.0:1788833102.957422:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265872640 00000100:00100000:1.0:1788833102.957460:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265872768 00000100:00100000:1.0:1788833102.957463:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265872768 00000100:00100000:1.0:1788833102.957479:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788833102.957486:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265872640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833102.957520:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833102.957563:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265872640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833102.957570:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788833102.957587:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788833102.957594:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265872768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833102.957631:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833102.957659:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265872768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833102.957664:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788833102.957701:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3f5a9f80 x1875727265872640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833102.957719:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265872640:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788833102.957729:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3957a680 x1875727265872768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833102.957738:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3957a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265872768:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788833103.402158:0:11134:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcc57fc90 20000000:00000080:1.0:1788833103.402174:0:11134:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cea1f363000 uarg=0000000000000000 20000000:01000000:1.0:1788833103.402209:0:11134:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788833103.402215:0:11134:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788833103.402219:0:11134:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788833103.403321:0:11135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788833103.403490:0:11134:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788833103.408796:0:11134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788833103.408824:0:11134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408845:0:11134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408855:0:11134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408862:0:11134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408869:0:11134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408876:0:11134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408912:0:11134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408956:0:11134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.408972:0:11134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 12 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.408986:0:11134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265872896:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833103.409194:0:11134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.409203:0:11134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 18 pid: 5807 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.409213:0:11134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873024:0@lo:104: 00000100:00100000:3.0:1788833103.409254:0:11134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833103.409298:0:11134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.409306:0:11134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 18 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.409313:0:11134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873152:0@lo:104: 00000100:00100000:3.0:1788833103.409333:0:11134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833103.409359:0:11134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.409379:0:11134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 18 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.409387:0:11134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873280:0@lo:104: 00000100:00100000:3.0:1788833103.409410:0:11134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833103.409433:0:11134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.409441:0:11134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 12 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.409448:0:11134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873408:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833103.409469:0:11134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324300 going to sleep for 11 seconds 00000100:00100000:2.0:1788833103.411792:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265873024 00000100:00100000:2.0:1788833103.411806:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265873024 00000100:00100000:2.0:1788833103.411858:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265873152 00000100:00100000:2.0:1788833103.411862:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265873152 00000100:00100000:2.0:1788833103.411874:0:7599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265873280 00000100:00100000:2.0:1788833103.411876:0:7599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265873280 00000100:00100000:2.0:1788833103.411905:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788833103.411913:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:11134:x1875727265873024:12345-0@lo:104: 00010000:00010000:2.0:1788833103.411929:0:7599:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412058:0:7599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833103.412065:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+5:11134:x1875727265873024:12345-0@lo:104: Request processed in 153us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.412072:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788833103.412091:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788833103.412098:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:11134:x1875727265873152:12345-0@lo:104: 00010000:00010000:2.0:1788833103.412106:0:7599:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412141:0:7599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788833103.412146:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:11134:x1875727265873152:12345-0@lo:104: Request processed in 50us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.412152:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788833103.412165:0:7599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788833103.412171:0:7599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:11134:x1875727265873280:12345-0@lo:104: 00010000:00010000:2.0:1788833103.412180:0:7599:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412215:0:7599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788833103.412219:0:7599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:11134:x1875727265873280:12345-0@lo:104: Request processed in 50us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.412225:0:7599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788833103.412247:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788833103.412253:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412270:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dce00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833103.412274:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412283:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833103.412290:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833103.412295:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833103.412331:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412337:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833103.412357:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412363:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea421dce00/0x8c08e876ed3fea42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea49 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412377:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833103.412380:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412386:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932ea00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833103.412389:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412406:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833103.412413:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833103.412418:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833103.412432:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412437:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833103.412452:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412458:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea3932ea00/0x8c08e876ed3fea34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea3b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412466:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833103.412469:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412473:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516000 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833103.412476:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412482:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833103.412487:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833103.412497:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833103.412511:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412516:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833103.412521:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412527:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3fea26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412539:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833103.412541:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833103.412542:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833103.412549:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833103.412575:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265873536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833103.412616:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833103.412663:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265873664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833103.412686:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833103.412702:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833103.412708:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265873792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833103.412726:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833103.412753:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265873536 00000100:00100000:2.0:1788833103.412757:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265873536 00010000:00010000:2.0:1788833103.412777:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 19 pid: 5807 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833103.412796:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265873664 00000100:00100000:2.0:1788833103.412807:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265873664 00010000:00010000:2.0:1788833103.412820:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 20 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833103.412832:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265873792 00000100:00100000:2.0:1788833103.412835:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265873792 00010000:00010000:2.0:1788833103.412846:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 21 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833103.412858:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788833103.412864:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+21:3277:x1875727265873536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833103.412874:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833103.412893:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 21 pid: 5807 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412903:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 21 pid: 5807 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.412920:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833103.412949:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+21:3277:x1875727265873536:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.412958:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788833103.412999:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833103.413005:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+20:3278:x1875727265873664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833103.413012:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833103.413017:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 20 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.413024:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 20 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.413066:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833103.413097:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+20:3278:x1875727265873664:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.413103:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833103.413115:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788833103.413120:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265873792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833103.413128:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833103.413132:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 19 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.413140:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 19 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.413149:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833103.413170:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265873792:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.413175:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788833103.413212:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265873792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833103.413220:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265873664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833103.413244:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265873536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788833103.413513:0:11134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517c00/0x8c08e876ed3fea49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fea42 expref: 18 pid: 5807 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.413526:0:11134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873024:0@lo:104: 00010000:00010000:3.0:1788833103.413537:0:11134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dde00/0x8c08e876ed3fea3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fea34 expref: 17 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.413547:0:11134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873152:0@lo:104: 00010000:00010000:3.0:1788833103.413558:0:11134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3fea2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fea26 expref: 16 pid: 5806 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833103.413566:0:11134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873280:0@lo:104: 00010000:00010000:0.0:1788833103.413729:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833103.413852:0:11134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265872896:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833103.416639:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833103.417263:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402176 00000100:00100000:2.0:1788833103.417273:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402176 00010000:00010000:2.0:1788833103.417312:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 13 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833103.417343:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:2.0:1788833103.417360:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256402176:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833103.417375:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833103.417380:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 13 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.417391:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 13 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.417408:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932fc00/0x8c08e876ed3fea5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72addc expref: 13 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.417425:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833103.417484:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:2358:x1875727256402176:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 125us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.417491:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:0.0:1788833103.418024:0:11134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11134:1875727265873408:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833103.418106:0:11134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833103.420599:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833103.420680:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402304 00000100:00100000:2.0:1788833103.420692:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402304 00010000:00010000:2.0:1788833103.420748:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 12 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833103.420787:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:2.0:1788833103.420796:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:2357:x1875727256402304:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833103.420809:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833103.420814:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 12 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420837:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 12 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420876:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3fea1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ada4 expref: 12 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420902:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420909:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420926:0:8413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420934:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420940:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420947:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420952:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833103.420956:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.420963:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.424245:0:11134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833103.424263:0:11134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.425616:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.425645:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dd000/0x8c08e876ed3fea7a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833103.425667:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833103.425998:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:2357:x1875727256402304:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 5197us (5402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833103.426009:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 29 00010000:00010000:2.0:1788833103.856152:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833104.719666:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833104.719970:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402432 00000100:00100000:2.0:1788833104.719980:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402432 00000100:00100000:2.0:1788833104.720049:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 227 00000100:00100000:2.0:1788833104.720058:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:5599:x1875727256402432:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833104.720074:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833104.720091:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae06 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833104.720116:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833104.720127:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833104.720136:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea00031200, rc 0) 00000100:00100000:2.0:1788833104.720186:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256402432:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 129us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833104.720193:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 227 00000100:00100000:3.0:1788833104.733380:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833104.733464:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402560 00000100:00100000:0.0:1788833104.733474:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402560 00000100:00100000:0.0:1788833104.733528:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 228 00000100:00100000:0.0:1788833104.733537:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256402560:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833104.733802:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256402560:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 265us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833104.733810:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 228 00000100:00100000:2.0:1788833104.737917:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833104.738066:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402688 00000100:00100000:0.0:1788833104.738077:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402688 00000100:00100000:0.0:1788833104.738127:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 229 00000100:00100000:0.0:1788833104.738136:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256402688:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833104.738330:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256402688:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 194us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833104.738338:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 229 00000100:00100000:1.0:1788833104.756266:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833104.756363:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402816 00000100:00100000:0.0:1788833104.756385:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402816 00000100:00100000:0.0:1788833104.756451:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 230 00000100:00100000:0.0:1788833104.756461:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256402816:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833104.756475:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833104.756491:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae0d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833104.756517:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833104.756527:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833104.756536:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476600, rc 0) 00000100:00100000:0.0:1788833104.756594:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256402816:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833104.756600:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 230 00000100:00100000:3.0:1788833104.760553:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833104.760667:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256402944 00000100:00100000:0.0:1788833104.760676:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256402944 00000100:00100000:0.0:1788833104.760988:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 231 00000100:00100000:0.0:1788833104.761000:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256402944:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833104.761322:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256402944:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 323us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833104.761330:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 231 00000100:00100000:1.0:1788833104.768505:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833104.774064:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256403072 00000100:00100000:2.0:1788833104.774079:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256403072 00000100:00100000:2.0:1788833104.774142:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 232 00000100:00100000:2.0:1788833104.774152:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256403072:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833104.774369:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256403072:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 217us (5871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833104.774377:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 232 00010000:00010000:1.0:1788833104.882988:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788833105.147374:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788833105.147382:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea06626000 from 7 10000000:01000000:3.0:1788833105.147387:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833105.147432:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.147443:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.147454:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833105.147480:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265873920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.147733:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833105.147835:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833105.148692:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265873920 00000100:00100000:0.0:1788833105.148701:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265873920 00000100:00100000:0.0:1788833105.148756:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788833105.148766:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265873920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833105.148792:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833105.148807:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fea8f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.148831:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.148842:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.148850:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477a00, rc 0) 00000100:00100000:0.0:1788833105.148918:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265873920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833105.148925:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788833105.150798:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265873920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833105.150822:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833105.150835:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833105.150919:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3957a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833105.150968:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833105.151082:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c74d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788833105.153644:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874048 00000100:00100000:3.0:1788833105.153657:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874048 00000100:00100000:3.0:1788833105.153846:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788833105.153859:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265874048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.154161:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265874048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833105.154168:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788833105.154263:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3957a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833105.154311:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3957a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833105.154356:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833105.159985:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c74d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833105.160144:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874176 00000100:00100000:0.0:1788833105.160153:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874176 00000100:00100000:0.0:1788833105.160278:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788833105.160290:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265874176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833105.160506:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265874176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (6149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833105.160514:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788833105.160667:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3957a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788833105.166417:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788833105.166772:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788833105.166800:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833105.166811:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.166823:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833105.166833:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788833105.166836:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea1fc5c800 from 7 10000000:01000000:3.0:1788833105.166839:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833105.166888:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.166896:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.166907:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833105.166932:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.166997:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833105.167066:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324780 going to sleep for 11 seconds 00000100:00100000:0.0:1788833105.167126:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874304 00000100:00100000:0.0:1788833105.167134:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874304 00000100:00100000:0.0:1788833105.167178:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788833105.167187:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265874304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833105.167199:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833105.167212:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fea9d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.167263:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.167274:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.167283:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476a00, rc 0) 00000100:00100000:0.0:1788833105.167322:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265874304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833105.167328:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788833105.175287:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833105.175315:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.175328:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833105.175426:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.175481:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833105.175533:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324780 going to sleep for 11 seconds 00000100:00100000:1.0:1788833105.176309:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874432 00000100:00100000:1.0:1788833105.176317:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874432 00000100:00100000:1.0:1788833105.176370:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788833105.176380:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265874432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833105.176879:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265874432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 490us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833105.176893:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788833105.181465:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.181532:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.181834:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833105.181888:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324780 going to sleep for 11 seconds 00000100:00100000:0.0:1788833105.181967:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874560 00000100:00100000:0.0:1788833105.181974:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874560 00000100:00100000:0.0:1788833105.182023:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788833105.182063:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265874560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833105.182255:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265874560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833105.182262:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788833105.185564:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788833105.186612:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788833105.186813:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788833105.186843:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833105.186853:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.186864:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833105.186882:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788833105.186884:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea100dd800 from 7 10000000:01000000:3.0:1788833105.186887:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833105.186919:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.186926:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.186934:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833105.186964:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.187020:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833105.187075:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324780 going to sleep for 11 seconds 00000100:00100000:0.0:1788833105.189084:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874688 00000100:00100000:0.0:1788833105.189097:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874688 00000100:00100000:0.0:1788833105.189153:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788833105.189163:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265874688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833105.189178:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833105.189194:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3feaab expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.189239:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.189250:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.189258:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476e00, rc 0) 00000100:00100000:0.0:1788833105.189322:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265874688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833105.189329:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788833105.190245:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833105.190266:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833105.190277:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833105.190350:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.190390:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833105.190521:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324780 going to sleep for 11 seconds 00000100:00100000:0.0:1788833105.191535:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874816 00000100:00100000:0.0:1788833105.191545:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874816 00000100:00100000:0.0:1788833105.191639:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788833105.191648:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265874816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833105.192095:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265874816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 447us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833105.192103:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788833105.192192:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.192238:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833105.192283:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833105.200186:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324780 going to sleep for 11 seconds 00000100:00100000:1.0:1788833105.200467:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265874944 00000100:00100000:1.0:1788833105.200478:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265874944 00000100:00100000:1.0:1788833105.200526:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788833105.200535:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265874944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833105.203075:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265874944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2532us (10783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833105.203089:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788833105.203231:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265874944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788833105.205356:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788833105.207218:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788833105.207262:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788833105.207273:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.207286:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833105.901402:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833106.645974:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833106.646005:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833106.646503:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256403200 00000100:00100000:0.0:1788833106.646527:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256403200 00000100:00100000:0.0:1788833106.646581:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 242 00000100:00100000:0.0:1788833106.646591:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256403200:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833106.646667:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256403200:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 78us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833106.646680:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 242 00000100:00100000:3.0:1788833106.646953:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256403456 00000100:00100000:3.0:1788833106.646957:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256403456 00000100:00100000:1.0:1788833106.647026:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833106.647063:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256403328 00000100:00100000:1.0:1788833106.647068:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256403328 00000100:00100000:1.0:1788833106.647104:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00100000:1.0:1788833106.647112:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256403456:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833106.647148:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256403456:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 37us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833106.650499:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 85 00000100:00100000:3.0:1788833106.650536:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256403328:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833106.650622:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256403328:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 110us (3596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833106.650639:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 85 00000100:00080000:3.0:1788833106.650678:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833106.652572:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 84 00010000:00010000:2.0:1788833106.925259:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788833107.080643:0:11331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788833107.566215:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265875072:0@lo:400:kworker.0 00000100:00100000:0.0:1788833107.566231:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265875456:0@lo:400:kworker.0 00000100:00100000:3.0:1788833107.566346:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265875200:0@lo:400:kworker.0 00000100:00100000:1.0:1788833107.566417:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265875328:0@lo:400:kworker.0 00000100:00100000:0.0:1788833107.570287:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833107.570395:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875456 00000100:00100000:0.0:1788833107.570403:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875456 00000100:00100000:0.0:1788833107.570461:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788833107.570470:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265875456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833107.570525:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265875456:12345-0@lo:400:kworker.0 Request processed in 57us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833107.570532:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788833107.570553:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788833107.570579:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc46300 x1875727265875456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833107.570592:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265875456:0@lo:400:kworker.0 00000100:00100000:2.0:1788833107.571942:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833107.572071:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265875584:0@lo:400:kworker.0 00000100:00100000:2.0:1788833107.572110:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833107.572141:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875584 00000100:00100000:2.0:1788833107.572146:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875584 00000100:00100000:2.0:1788833107.572187:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788833107.572196:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265875584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833107.572236:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265875584:12345-0@lo:400:kworker.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833107.572243:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788833107.572261:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833107.572281:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265875584:0@lo:400:kworker.0 00000100:00100000:3.0:1788833107.574529:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833107.574643:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265875712:0@lo:400:kworker.0 00000100:00100000:3.0:1788833107.574687:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833107.574715:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875712 00000100:00100000:3.0:1788833107.574722:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875712 00000100:00100000:3.0:1788833107.574787:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788833107.574798:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265875712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833107.574844:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265875712:12345-0@lo:400:kworker.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833107.574851:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788833107.574904:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc47800 x1875727265875712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833107.574918:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265875712:0@lo:400:kworker.0 00000100:00080000:3.0:1788833107.574963:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833107.574971:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875072 00000100:00100000:0.0:1788833107.574978:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875072 00000100:00100000:0.0:1788833107.575022:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788833107.575051:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265875072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833107.575093:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265875072:12345-0@lo:400:kworker.0 Request processed in 64us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833107.575111:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788833107.577069:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833107.577147:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265875072:0@lo:400:kworker.0 00000100:00100000:2.0:1788833107.586012:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875200 00000100:00100000:2.0:1788833107.586027:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875200 00000100:00100000:2.0:1788833107.586107:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875328 00000100:00100000:2.0:1788833107.586111:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875328 00000100:00100000:2.0:1788833107.586157:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788833107.586167:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265875200:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788833107.586174:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833107.586281:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265875200:12345-0@lo:400:kworker.0 Request processed in 115us (11759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833107.586288:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788833107.586307:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788833107.586313:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265875328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833107.586345:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265875328:12345-0@lo:400:kworker.0 Request processed in 33us (9281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833107.586351:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788833107.587090:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265875328:0@lo:400:kworker.0 00000100:00100000:1.0:1788833107.587134:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265875200:0@lo:400:kworker.0 00010000:00010000:1.0:1788833107.949423:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833108.078781:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265875968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833108.078843:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833108.078928:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788833108.078935:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265875840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833108.078958:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833108.079058:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875968 00000100:00100000:2.0:1788833108.079065:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875968 00000100:00100000:2.0:1788833108.079098:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265875840 00000100:00100000:2.0:1788833108.079101:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265875840 00000100:00100000:2.0:1788833108.079117:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788833108.079125:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265875968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833108.079158:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833108.079210:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265875968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833108.079218:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788833108.079236:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788833108.079242:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265875840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833108.079263:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833108.079291:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265875840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833108.079297:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788833108.080632:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc46300 x1875727265875840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833108.080667:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265875840:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788833108.080681:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea066cc380 x1875727265875968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833108.080706:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265875968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788833108.973529:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833109.997488:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788833110.696938:0:11432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:05:09 (1788833109) === 00000100:00100000:3.0:1788833110.843248:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833110.843289:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833110.843407:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256403584 00000100:00100000:2.0:1788833110.843417:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256403584 00000100:00100000:2.0:1788833110.843473:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:2.0:1788833110.843483:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256403584:12345-192.168.206.55@tcp:41:mkdir.0 00000004:00000024:2.0:1788833110.843531:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788833110.843603:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256403584:12345-192.168.206.55@tcp:41:mkdir.0 Request processed in 122us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833110.843610:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00080000:1.0:1788833110.843729:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833110.846450:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256403712 00000100:00100000:0.0:1788833110.846466:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256403712 00000100:00100000:0.0:1788833110.846629:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:0.0:1788833110.846642:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:9681:x1875727256403712:12345-192.168.206.55@tcp:700:mkdir.0 00000100:00100000:0.0:1788833110.846834:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:9681:x1875727256403712:12345-192.168.206.55@tcp:700:mkdir.0 Request processed in 195us (3542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833110.846851:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833110.852976:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833110.853015:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256403968 00000100:00100000:3.0:1788833110.853024:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256403968 00000100:00100000:3.0:1788833110.853102:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:3.0:1788833110.853113:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:9681:x1875727256403968:12345-192.168.206.55@tcp:36:mkdir.0 00010000:00010000:3.0:1788833110.853164:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833110.853230:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fe99a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad8f expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.853250:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:3.0:1788833110.853260:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833110.853585:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.853598:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.853607:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.854162:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.854177:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.854185:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833110.856786:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788833110.856803:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.856814:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.856821:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.856827:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dce00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833110.856831:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.856839:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.856867:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4700) 00010000:00010000:3.0:1788833110.856871:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833110.856877:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.856883:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feab9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833110.856913:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb2325cf reply state 00000000b26f9638 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833110.856923:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788833110.857164:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9681:x1875727256403968:12345-192.168.206.55@tcp:36:mkdir.0 Request processed in 4049us (4193us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788833110.857172:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00010000:00010000:1.0:1788833110.861309:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.861327:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.861335:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.861340:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833110.861344:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.861351:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.861371:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cea32de4d00) 00010000:00010000:1.0:1788833110.861374:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833110.861377:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.861383:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feac0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833110.885074:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833110.885107:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256404096 00000100:00100000:1.0:1788833110.885116:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256404096 00000100:00100000:1.0:1788833110.885164:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:1.0:1788833110.885174:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:9682:x1875727256404096:12345-192.168.206.55@tcp:101:chmod.0 00010000:00010000:1.0:1788833110.885194:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833110.885221:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e200/0x8c08e876ed3feac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae14 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.885282:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3feace lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.885295:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3feace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.885306:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3feace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833110.885336:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788833110.885339:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833110.885374:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3feace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.885399:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e200/0x8c08e876ed3feac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae14 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.885414:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3feace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae14 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833110.885423:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884ee00) 00010000:00010000:1.0:1788833110.885425:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833110.885428:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f200, rc 0) 00000100:00100000:1.0:1788833110.885486:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9682:x1875727256404096:12345-192.168.206.55@tcp:101:chmod.0 Request processed in 314us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833110.885494:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:1.0:1788833110.896991:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833110.898055:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256404352 00000100:00100000:3.0:1788833110.898067:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256404352 00000100:00100000:3.0:1788833110.898140:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1788833110.898150:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9682:x1875727256404352:12345-192.168.206.55@tcp:36:chmod.0 00010000:00010000:3.0:1788833110.898198:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833110.898224:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3feace lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae14 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.898240:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884ee00) 00010000:00010000:3.0:1788833110.898249:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833110.898273:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.898286:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.898295:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833110.898562:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ede114c reply state 000000001bf229f4 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833110.898582:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788833110.898589:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788833110.898667:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:9682:x1875727256404352:12345-192.168.206.55@tcp:36:chmod.0 Request processed in 519us (1685us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788833110.898674:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00010000:00010000:3.0:1788833110.911584:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.911602:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.911610:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.911617:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dce00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833110.911621:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.911630:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.911647:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4700) 00010000:00010000:3.0:1788833110.911651:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788833110.911656:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.911662:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fead5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833110.934712:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833110.935109:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256404480 00000100:00100000:3.0:1788833110.935131:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256404480 00000100:00100000:3.0:1788833110.935231:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:3.0:1788833110.935243:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9683:x1875727256404480:12345-192.168.206.55@tcp:101:chown.0 00010000:00010000:3.0:1788833110.935266:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833110.935289:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feadc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae1b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.935353:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3feae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.935366:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3feae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.935378:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3feae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833110.935411:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788833110.935414:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833110.935451:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3feae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.935474:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3feadc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae1b expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.935491:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3feae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae1b expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.935500:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4700) 00010000:00010000:3.0:1788833110.935503:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833110.935506:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dc600, rc 0) 00000100:00100000:3.0:1788833110.935574:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:9683:x1875727256404480:12345-192.168.206.55@tcp:101:chown.0 Request processed in 335us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833110.935581:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:1.0:1788833110.940758:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833110.941453:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256404608 00000100:00100000:3.0:1788833110.941464:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256404608 00000100:00100000:3.0:1788833110.941540:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:3.0:1788833110.941551:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+8:9683:x1875727256404608:12345-192.168.206.55@tcp:101:chown.0 00010000:00010000:3.0:1788833110.941570:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833110.941595:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feaea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae22 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941740:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941755:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941765:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941779:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941785:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941792:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941885:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feaff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941909:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833110.941915:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833110.945780:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788833110.945786:0:8616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833110.945818:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945835:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945854:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945861:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945867:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833110.945871:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945879:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945895:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4700) 00010000:00010000:2.0:1788833110.945912:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833110.945917:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945923:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feaf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945944:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945951:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945956:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945961:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833110.945964:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945969:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945983:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cea32de4b00) 00010000:00010000:2.0:1788833110.945985:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833110.945987:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.945993:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feaf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.946053:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3feaea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae22 expref: 10 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.946083:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feaff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae22 expref: 9 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.946090:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:2.0:1788833110.946092:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833110.946094:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516000, rc 0) 00000100:00100000:2.0:1788833110.946168:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:9683:x1875727256404608:12345-192.168.206.55@tcp:101:chown.0 Request processed in 4619us (5421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833110.946177:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:0.0:1788833110.953949:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833110.954084:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256404864 00000100:00100000:2.0:1788833110.954093:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256404864 00000100:00100000:2.0:1788833110.954148:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:2.0:1788833110.954158:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+9:9683:x1875727256404864:12345-192.168.206.55@tcp:36:chown.0 00010000:00010000:2.0:1788833110.954206:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833110.954231:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feaff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae22 expref: 9 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.954248:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:2.0:1788833110.954257:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833110.954280:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.954292:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833110.954302:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833111.021699:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833111.036110:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788833111.036411:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd20a971 reply state 000000001e3d8fe8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833111.036426:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788833111.036510:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788833111.036613:0:5811:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788833111.037136:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9683:x1875727256404864:12345-192.168.206.55@tcp:36:chown.0 Request processed in 82974us (83190us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788833111.037146:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00010000:00010000:3.0:1788833111.037377:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.037388:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.037396:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.037402:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00031a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833111.037406:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.037414:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.037429:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539cf00) 00010000:00010000:3.0:1788833111.037432:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788833111.037437:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.037444:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833111.072149:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.072262:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256404992 00000100:00100000:2.0:1788833111.072271:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256404992 00000100:00100000:2.0:1788833111.072407:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:2.0:1788833111.072419:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:9684:x1875727256404992:12345-192.168.206.55@tcp:101:touch.500 00010000:00010000:2.0:1788833111.072442:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833111.072477:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae29 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788833111.074571:0:5813:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2043us 00010000:00010000:2.0:1788833111.114604:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.114627:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.114639:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.114657:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.114665:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.114672:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.114984:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031e00/0x8c08e876ed3feb22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.114995:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031e00/0x8c08e876ed3feb22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115002:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031e00/0x8c08e876ed3feb22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833111.115024:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788833111.115028:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833111.115109:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031e00/0x8c08e876ed3feb22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115121:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115129:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115136:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115142:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00031000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833111.115146:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115153:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115167:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4700) 00010000:00010000:2.0:1788833111.115177:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833111.115182:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115189:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115203:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115210:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115217:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115223:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00030600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833111.115225:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115231:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115240:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833111.115243:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833111.115246:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115251:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115287:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae29 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115328:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031e00/0x8c08e876ed3feb22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae29 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.115336:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:2.0:1788833111.115338:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788833111.115340:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea00031e00, rc 0) 00000100:00100000:2.0:1788833111.115408:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9684:x1875727256404992:12345-192.168.206.55@tcp:101:touch.500 Request processed in 42991us (43268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833111.115416:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:1.0:1788833111.124457:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833111.124623:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256405248 00000100:00100000:3.0:1788833111.124636:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256405248 00000100:00100000:3.0:1788833111.124735:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1788833111.124989:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9684:x1875727256405248:12345-192.168.206.55@tcp:101:touch.500 00010000:00010000:3.0:1788833111.125021:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833111.125088:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3feb29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae30 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.128276:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.128308:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.128323:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.128345:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.128354:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.128361:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788833111.133549:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788833111.133908:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feb3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.133931:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.133943:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137460:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137477:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137485:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137492:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833111.137496:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137504:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137519:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:3.0:1788833111.137522:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833111.137526:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137533:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3feb30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833111.137548:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006446632f reply state 0000000018e018e4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833111.137568:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788833111.137619:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3feb29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae30 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137634:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feb3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae30 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.137641:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:3.0:1788833111.137643:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833111.137645:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516c00, rc 0) 00000100:00100000:3.0:1788833111.137719:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+10:9684:x1875727256405248:12345-192.168.206.55@tcp:101:touch.500 Request processed in 12974us (13277us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788833111.137727:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00010000:00010000:3.0:1788833111.140911:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.140936:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.140946:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.140953:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833111.140960:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.140969:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.141050:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9cea32de4300) 00010000:00010000:3.0:1788833111.141055:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833111.141062:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.141071:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3feb37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833111.142374:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.144228:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256405504 00000100:00100000:2.0:1788833111.144252:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256405504 00000100:00100000:2.0:1788833111.144348:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:2.0:1788833111.144360:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:9684:x1875727256405504:12345-192.168.206.55@tcp:36:touch.500 00010000:00010000:2.0:1788833111.144446:0:8616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833111.144483:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3feb3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae30 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.144506:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:2.0:1788833111.144519:0:8616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833111.144577:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.144594:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.144605:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833111.144792:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b36a020 reply state 000000006a02e1f3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833111.144818:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833111.144950:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+10:9684:x1875727256405504:12345-192.168.206.55@tcp:36:touch.500 Request processed in 591us (2587us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788833111.144958:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:1.0:1788833111.150560:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.150800:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256405632 00000100:00100000:2.0:1788833111.150814:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256405632 00000100:00100000:2.0:1788833111.150901:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:2.0:1788833111.150913:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+10:9684:x1875727256405632:12345-192.168.206.55@tcp:101:touch.500 00010000:00010000:2.0:1788833111.150944:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833111.150970:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae37 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.151088:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae37 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.151106:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae37 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.151132:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833111.151136:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833111.151141:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea00030600, rc 0) 00000100:00100000:2.0:1788833111.151216:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+11:9684:x1875727256405632:12345-192.168.206.55@tcp:101:touch.500 Request processed in 305us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833111.151223:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 24 00010000:00010000:3.0:1788833111.151482:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.151492:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.151500:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.151507:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00030200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833111.151512:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.151521:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.151536:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:3.0:1788833111.151539:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833111.151543:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.151550:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833111.154966:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833111.155179:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256405760 00000100:00100000:3.0:1788833111.155192:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256405760 00000100:00100000:3.0:1788833111.155255:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:3.0:1788833111.155266:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875727256405760:12345-192.168.206.55@tcp:8:touch.500 00010000:00080000:3.0:1788833111.155309:0:6654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1788833111.155353:0:6654:0:(genops.c:1385:class_connect()) connect: client 458534c2-c478-4b32-bcda-93b4ecf625e9, cookie 0x8c08e876ed3feb5a 00002000:00100000:3.0:1788833111.155369:0:6654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 458534c2-c478-4b32-bcda-93b4ecf625e9/ffff9cea4096e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788833111.155401:0:6654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1788833111.155955:0:6654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788833111.155997:0:6654:0:(import.c:65:import_set_state_nolock()) ffff9cea4096d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833111.159118:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2356:x1875727256405760:12345-192.168.206.55@tcp:8:touch.500 Request processed in 3837us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833111.159134:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:1.0:1788833111.170223:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833111.170472:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256405888 00000100:00100000:3.0:1788833111.170488:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256405888 00000100:00100000:3.0:1788833111.170621:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1788833111.170637:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:0:x1875727256405888:12345-192.168.206.55@tcp:2:touch.500 00000100:00080000:1.0:1788833111.171217:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833111.244424:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:0:x1875727256405888:12345-192.168.206.55@tcp:2:touch.500 Request processed in 73163us (73586us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788833111.244445:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000001:00080000:1.0:1788833111.245059:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788833111.245074:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000100:00100000:1.0:1788833111.246349:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.246707:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256406144 00000100:00100000:2.0:1788833111.246720:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256406144 00000100:00100000:2.0:1788833111.247021:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:2.0:1788833111.247058:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+10:9684:x1875727256406144:12345-192.168.206.55@tcp:35:touch.500 00000100:00100000:2.0:1788833111.247534:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+11:9684:x1875727256406144:12345-192.168.206.55@tcp:35:touch.500 Request processed in 501us (1193us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788833111.247543:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:3.0:1788833111.265261:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.266085:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256406272 00000100:00100000:2.0:1788833111.266100:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256406272 00000100:00100000:2.0:1788833111.266222:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:2.0:1788833111.266235:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+11:9685:x1875727256406272:12345-192.168.206.55@tcp:101:rm.0 00010000:00010000:2.0:1788833111.266267:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833111.266295:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae3e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.266399:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.266418:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.266432:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833111.266478:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788833111.266500:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833111.266549:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.266583:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae3e expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.266605:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae3e expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.266616:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:2.0:1788833111.266619:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833111.266623:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea00030200, rc 0) 00000100:00100000:2.0:1788833111.266714:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+12:9685:x1875727256406272:12345-192.168.206.55@tcp:101:rm.0 Request processed in 481us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833111.266722:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:1.0:1788833111.271588:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833111.271714:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256406528 00000100:00100000:0.0:1788833111.271731:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256406528 00000100:00100000:0.0:1788833111.271834:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:0.0:1788833111.271857:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+12:9685:x1875727256406528:12345-192.168.206.55@tcp:101:rm.0 00010000:00010000:0.0:1788833111.271888:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833111.271919:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3feb6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833111.272089:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788833111.272326:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3feb6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae45 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.272357:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4700) 00010000:00010000:0.0:1788833111.272362:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833111.272368:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3feb6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae45 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.272382:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476400, rc 0) 00000100:00100000:0.0:1788833111.272481:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:9685:x1875727256406528:12345-192.168.206.55@tcp:101:rm.0 Request processed in 628us (908us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788833111.272490:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:3.0:1788833111.275091:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833111.275180:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256406656 00000100:00100000:0.0:1788833111.275193:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256406656 00000100:00100000:0.0:1788833111.275271:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:0.0:1788833111.275285:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+13:9685:x1875727256406656:12345-192.168.206.55@tcp:37:rm.0 00000100:00100000:0.0:1788833111.285943:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+13:9685:x1875727256406656:12345-192.168.206.55@tcp:37:rm.0 Request processed in 10433us (10638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833111.285960:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:1.0:1788833111.304752:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.307665:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256406912 00000100:00100000:2.0:1788833111.308337:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256406912 00000100:00100000:3.0:1788833111.312007:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1788833111.312028:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:9685:x1875727256406912:12345-192.168.206.55@tcp:35:rm.0 00000100:00100000:3.0:1788833111.312398:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:9685:x1875727256406912:12345-192.168.206.55@tcp:35:rm.0 Request processed in 375us (7730us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788833111.312406:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1788833111.318026:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833111.318620:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256407168 00000100:00100000:1.0:1788833111.318634:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256407168 00000100:00100000:2.0:1788833111.318810:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:2.0:1788833111.318827:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+14:9685:x1875727256407168:12345-192.168.206.55@tcp:101:rm.0 00010000:00010000:2.0:1788833111.318871:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833111.318900:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae4c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.319019:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030000/0x8c08e876ed3feb84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.319064:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030000/0x8c08e876ed3feb84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.319099:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030000/0x8c08e876ed3feb84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833111.319114:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788833111.319616:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae4c expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.319643:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030000/0x8c08e876ed3feb84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae4c expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.319654:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:2.0:1788833111.319658:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788833111.319662:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea00030000, rc 0) 00000100:00100000:2.0:1788833111.319951:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+16:9685:x1875727256407168:12345-192.168.206.55@tcp:101:rm.0 Request processed in 1127us (1938us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788833111.319960:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:1.0:1788833111.323450:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833111.324373:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256407296 00000100:00100000:0.0:1788833111.324389:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256407296 00000100:00100000:0.0:1788833111.324479:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:0.0:1788833111.324492:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+16:9685:x1875727256407296:12345-192.168.206.55@tcp:41:rm.0 00000004:00000024:0.0:1788833111.324574:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788833111.324686:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+16:9685:x1875727256407296:12345-192.168.206.55@tcp:41:rm.0 Request processed in 196us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833111.324694:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:0.0:1788833111.331432:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.331847:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256407424 00000100:00100000:2.0:1788833111.331861:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256407424 00000100:00100000:2.0:1788833111.331944:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:2.0:1788833111.331956:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+16:9685:x1875727256407424:12345-192.168.206.55@tcp:101:rm.0 00010000:00010000:2.0:1788833111.331983:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833111.332012:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae53 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332147:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332192:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332207:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332243:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332253:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332259:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332438:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332447:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.332456:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833111.332489:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788833111.332494:0:8616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833111.332523:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333364:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333399:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333406:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333414:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333420:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00031a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833111.333424:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333433:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333450:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:2.0:1788833111.333453:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833111.333459:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333466:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031a00/0x8c08e876ed3feb99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333487:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333494:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333501:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333512:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833111.333515:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.333522:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.334734:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9cea1539c600) 00010000:00010000:2.0:1788833111.334739:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833111.334745:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.334755:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.335111:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031000/0x8c08e876ed3feb92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae53 expref: 18 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.335133:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae53 expref: 17 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.335141:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833111.335144:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833111.335146:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036400, rc 0) 00000100:00100000:2.0:1788833111.335306:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+17:9685:x1875727256407424:12345-192.168.206.55@tcp:101:rm.0 Request processed in 3350us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833111.335317:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:3.0:1788833111.347633:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833111.347753:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256407680 00000100:00100000:0.0:1788833111.347768:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256407680 00000100:00100000:0.0:1788833111.347854:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:0.0:1788833111.347867:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+17:9685:x1875727256407680:12345-192.168.206.55@tcp:36:rm.0 00010000:00010000:0.0:1788833111.348725:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788833111.348773:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae53 expref: 17 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.348806:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030600/0x8c08e876ed3feb53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae37 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.348821:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:0.0:1788833111.348857:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030200/0x8c08e876ed3feb68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae3e expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.348867:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:0.0:1788833111.348871:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833111.350360:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350389:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350403:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350425:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350456:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350464:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350620:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350630:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.350637:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833111.351570:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788833111.351584:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 245417552093ns, next at 246417549290ns, rc = 0 00010000:00010000:0.0:1788833111.351658:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351672:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351681:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351690:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351697:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351715:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351750:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833111.351776:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351782:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351789:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351796:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833111.351801:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351809:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351824:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:0.0:1788833111.351827:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788833111.351832:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351846:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3febbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351870:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351876:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351888:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351894:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833111.351897:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351903:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351911:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:0.0:1788833111.351914:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833111.351917:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.351923:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3febae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788833111.351932:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018f57e1d reply state 00000000de8f35e6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833111.351943:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788833111.352709:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833111.352721:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833111.352730:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477e00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833111.352733:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833111.352743:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833111.352757:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:1.0:1788833111.352759:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788833111.352762:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833111.352780:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477e00/0x8c08e876ed3febc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833111.352804:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833111.352806:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833111.352808:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833111.353475:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+16:9685:x1875727256407680:12345-192.168.206.55@tcp:36:rm.0 Request processed in 5602us (5850us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788833111.353487:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 30 00010000:00010000:0.0:1788833111.355410:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.355433:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.355464:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.355471:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833111.355476:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.355485:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.355508:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9cea08db1300) 00010000:00010000:0.0:1788833111.355511:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833111.355518:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833111.355524:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3febb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833111.361437:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833111.362376:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256407936 00000100:00100000:0.0:1788833111.362392:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256407936 00000100:00100000:0.0:1788833111.362516:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:0.0:1788833111.362529:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+15:9685:x1875727256407936:12345-192.168.206.55@tcp:35:rm.0 00000100:00100000:0.0:1788833111.362901:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+16:9685:x1875727256407936:12345-192.168.206.55@tcp:35:rm.0 Request processed in 374us (1480us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788833111.362909:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:3.0:1788833111.367983:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833111.368260:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256408192 00000100:00100000:2.0:1788833111.368283:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256408192 00000100:00100000:2.0:1788833111.368360:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:2.0:1788833111.368372:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+16:9685:x1875727256408192:12345-192.168.206.55@tcp:36:rm.0 00010000:00010000:2.0:1788833111.368460:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788833111.368496:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00030000/0x8c08e876ed3feb84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae4c expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368525:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea00031e00/0x8c08e876ed3feb22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae29 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368538:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539ca00) 00010000:00010000:2.0:1788833111.368740:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3feae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae1b expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368754:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4700) 00010000:00010000:2.0:1788833111.368763:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833111.368793:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368807:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368817:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368829:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368836:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.368863:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.370191:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.370280:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.370294:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833111.371870:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788833111.371899:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.371910:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.371918:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.371925:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036e00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833111.371930:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.371939:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.371956:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833111.371960:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788833111.371974:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.371981:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3febd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.372023:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.372064:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.372070:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.372075:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833111.372078:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.372085:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.372093:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:2.0:1788833111.372095:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833111.372098:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833111.372104:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3febca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833111.372118:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb12ae5e reply state 000000003632c3f8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833111.372140:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833111.372511:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+15:9685:x1875727256408192:12345-192.168.206.55@tcp:36:rm.0 Request processed in 4133us (4535us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788833111.372524:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 31 00010000:00010000:3.0:1788833111.375668:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.375755:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.375764:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.375770:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833111.375775:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.375856:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.375880:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cea1539c400) 00010000:00010000:3.0:1788833111.375884:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833111.375890:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833111.375897:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3febd1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833111.761277:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833111.761588:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256408320 00000100:00100000:1.0:1788833111.761602:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256408320 00000100:00100000:1.0:1788833111.761691:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 244 00000100:00100000:1.0:1788833111.761704:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256408320:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833111.761813:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256408320:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 112us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833111.761822:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 244 00000100:00100000:1.0:1788833111.764282:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833111.764333:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833111.764477:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256408448 00000100:00100000:0.0:1788833111.764489:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256408448 00000100:00100000:0.0:1788833111.764549:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256408704 00000100:00100000:0.0:1788833111.764566:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256408704 00000100:00100000:0.0:1788833111.764624:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 89 00000100:00100000:0.0:1788833111.764635:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:2358:x1875727256408448:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833111.764745:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:2358:x1875727256408448:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 112us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833111.764753:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 89 00000100:00100000:0.0:1788833111.764771:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:0.0:1788833111.764777:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256408704:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833111.764809:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2358:x1875727256408704:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833111.764815:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00080000:1.0:1788833111.766191:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833111.766607:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833111.766687:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256408576 00000100:00100000:1.0:1788833111.766697:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256408576 00000100:00100000:1.0:1788833111.766764:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:1.0:1788833111.766774:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256408576:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833111.766866:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256408576:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 94us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833111.766874:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 51 00010000:00010000:2.0:1788833112.045184:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833112.696321:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265876224:0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.696407:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833112.696491:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265876736:0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.696520:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833112.696556:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788833112.696562:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265876096:0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.696592:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833112.696614:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265876608:0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.696635:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833112.696666:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265876352:0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.696690:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833112.696708:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833112.696714:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265876480:0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.696736:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833112.697633:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876224 00000100:00100000:2.0:1788833112.697645:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876224 00000100:00100000:2.0:1788833112.697697:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876608 00000100:00100000:2.0:1788833112.697700:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876608 00000100:00100000:2.0:1788833112.697722:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876352 00000100:00100000:2.0:1788833112.697725:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876352 00000100:00100000:2.0:1788833112.697746:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788833112.697859:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833112.698887:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265876224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.699013:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265876224:12345-0@lo:400:kworker.0 Request processed in 133us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833112.699022:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788833112.699072:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788833112.699080:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265876608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.699115:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265876608:12345-0@lo:400:kworker.0 Request processed in 36us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833112.699121:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788833112.699133:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788833112.699140:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265876352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.699180:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265876352:12345-0@lo:400:kworker.0 Request processed in 41us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833112.699186:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788833112.699215:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876736 00000100:00100000:2.0:1788833112.699222:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876736 00000100:00100000:2.0:1788833112.699284:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876480 00000100:00100000:2.0:1788833112.699288:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876480 00000100:00100000:2.0:1788833112.699311:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788833112.699317:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265876736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.699352:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265876736:12345-0@lo:400:kworker.0 Request processed in 35us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833112.699358:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788833112.699369:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788833112.699374:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265876480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.699528:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265876480:12345-0@lo:400:kworker.0 Request processed in 29us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833112.699545:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788833112.699569:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876096 00000100:00100000:2.0:1788833112.699573:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876096 00000100:00100000:2.0:1788833112.699601:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788833112.699607:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265876096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.699642:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265876096:12345-0@lo:400:kworker.0 Request processed in 35us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833112.699648:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788833112.699709:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833112.699712:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788833112.699746:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea066cc380 x1875727265876480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833112.699777:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265876480:0@lo:400:kworker.0 00000100:00100000:2.0:1788833112.699794:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265876352:0@lo:400:kworker.0 00000100:00100000:1.0:1788833112.700285:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265876096:0@lo:400:kworker.0 00000100:00100000:1.0:1788833112.700316:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265876608:0@lo:400:kworker.0 00000100:00100000:1.0:1788833112.700329:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265876224:0@lo:400:kworker.0 00010000:00080000:1.0:1788833112.700343:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40d81c00 x1875727265876736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833112.700353:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265876736:0@lo:400:kworker.0 00010000:00010000:3.0:1788833113.070333:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833113.199888:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265876864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833113.200015:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833113.205130:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833113.205161:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265876992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833113.205255:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788833113.205492:0:7128:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 247271459696ns, next at 248271455671ns, rc = 0 00000100:00100000:0.0:1788833113.208781:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876864 00000100:00100000:0.0:1788833113.208806:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876864 00000100:00100000:0.0:1788833113.208995:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265876992 00000100:00100000:0.0:1788833113.209001:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265876992 00000100:00100000:0.0:1788833113.209026:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788833113.209055:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265876864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833113.209113:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833113.209219:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265876864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (9204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833113.209228:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788833113.209250:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788833113.209257:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265876992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788833113.209280:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833113.209386:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265876992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833113.209403:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788833113.213877:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea05ca8e00 x1875727265876992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833113.213918:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265876992:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788833113.213939:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc45880 x1875727265876864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833113.213951:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265876864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788833114.104809:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833115.117243:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788833115.638617:0:11583:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788833116.141734:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833116.352479:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1788833116.352507:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1788833116.353173:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788833116.353803:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265877120:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788833116.353917:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1788833116.354266:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1788833116.359155:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265877120 00000100:00100000:2.0:1788833116.359177:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265877120 00000100:00100000:3.0:1788833116.362792:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788833116.362841:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265877120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788833116.362925:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788833116.362978:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f6d56, atime: 0x6a9f6d56, ctime: 0x6a9f6d56, blocks: 0x1 00010000:00010000:3.0:1788833116.363001:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363023:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=250s v=(0 0) 00010000:00010000:3.0:1788833116.363068:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833116.363077:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363099:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363110:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363118:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363141:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833116.363158:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833116.363165:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363173:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833116.363178:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363201:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363222:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363230:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055457776/0x8c08e876ed3febdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833116.363254:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833116.363256:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833116.363258:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788833116.364367:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833116.367662:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1875727265877120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4843us (13733us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788833116.367681:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788833116.368026:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea05caad80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788833116.368175:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265877120:0@lo:6:osp-syn-0-0.0 00000020:00000080:0.0:1788833116.788464:0:11633:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff17476c70 20000000:00000080:0.0:1788833116.788490:0:11633:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cea3fb62000 uarg=0000000000000000 20000000:01000000:0.0:1788833116.788539:0:11633:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788833116.788547:0:11633:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788833116.788553:0:11633:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788833116.789844:0:11634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788833116.790198:0:11633:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788833116.799007:0:11633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788833116.799300:0:11633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788833116.799374:0:11633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788833116.799399:0:11633:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788833116.799427:0:11633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799452:0:11633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799461:0:11633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799469:0:11633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799495:0:11633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799501:0:11633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799510:0:11633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799559:0:11633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.799576:0:11633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 18 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.799594:0:11633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877248:0@lo:104: 00000100:00100000:0.0:1788833116.799678:0:11633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788833116.800529:0:11633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.800542:0:11633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 18 pid: 5807 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.800555:0:11633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877376:0@lo:104: 00000100:00100000:0.0:1788833116.800596:0:11633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788833116.800738:0:11633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.800747:0:11633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 18 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.800771:0:11633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877504:0@lo:104: 00000100:00100000:0.0:1788833116.800800:0:11633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833116.800939:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265877248 00000100:00100000:2.0:1788833116.800950:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265877248 00000100:00100000:2.0:1788833116.801019:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265877376 00000100:00100000:2.0:1788833116.801023:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265877376 00000100:00100000:2.0:1788833116.801066:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788833116.801077:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:11633:x1875727265877248:12345-0@lo:104: 00010000:00010000:2.0:1788833116.801113:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801170:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833116.801177:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+4:11633:x1875727265877248:12345-0@lo:104: Request processed in 102us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833116.801185:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788833116.801221:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833116.801229:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:11633:x1875727265877376:12345-0@lo:104: 00010000:00010000:2.0:1788833116.801236:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801271:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788833116.801276:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:11633:x1875727265877376:12345-0@lo:104: Request processed in 49us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833116.801281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788833116.801298:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833116.801305:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801313:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dca00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833116.801317:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801326:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833116.801334:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833116.801347:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833116.801386:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801393:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833116.801415:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801422:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea421dca00/0x8c08e876ed3feaab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3feab2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801439:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833116.801443:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801448:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dde00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833116.801450:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801456:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833116.801462:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833116.801467:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833116.801480:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801485:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833116.801506:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801512:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea421dde00/0x8c08e876ed3fea9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3feaa4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801525:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833116.801526:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833116.801528:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833116.801626:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833116.801634:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833116.801649:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265877632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833116.801702:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833116.801735:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833116.801744:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265877760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833116.801770:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833116.801799:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265877632 00000100:00100000:2.0:1788833116.801803:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265877632 00010000:00010000:2.0:1788833116.801835:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 19 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833116.801857:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265877760 00000100:00100000:2.0:1788833116.801860:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265877760 00010000:00010000:2.0:1788833116.801871:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 20 pid: 5807 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833116.801889:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788833116.801896:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+20:3276:x1875727265877632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833116.801908:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833116.801914:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 20 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801933:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 20 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.801954:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833116.801984:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+20:3276:x1875727265877632:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833116.801991:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788833116.802006:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788833116.802012:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265877760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833116.802020:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833116.802024:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 19 pid: 5807 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.802056:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 19 pid: 5807 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.802066:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833116.802093:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265877760:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833116.802100:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788833116.802145:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265877760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833116.802174:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265877632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788833116.802844:0:11633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.802861:0:11633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 12 pid: 5807 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.802875:0:11633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877888:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833116.803738:0:11633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.803755:0:11633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.803769:0:11633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265878016:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833116.803844:0:11633:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07f0bc00 going to sleep for 11 seconds 00010000:00010000:0.0:1788833116.803876:0:11633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32476e00/0x8c08e876ed3feab2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3feaab expref: 18 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.803893:0:11633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877248:0@lo:104: 00010000:00010000:0.0:1788833116.803907:0:11633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32476a00/0x8c08e876ed3feaa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fea9d expref: 17 pid: 5807 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.803915:0:11633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877376:0@lo:104: 00000100:00100000:3.0:1788833116.804073:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265877504 00000100:00100000:3.0:1788833116.804082:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265877504 00000100:00100000:2.0:1788833116.804329:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788833116.804348:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788833116.804359:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:11633:x1875727265877504:12345-0@lo:104: 00010000:00010000:2.0:1788833116.804374:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804481:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833116.804489:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+3:11633:x1875727265877504:12345-0@lo:104: Request processed in 131us (3687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833116.804497:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788833116.804556:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833116.804564:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804572:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd200 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833116.804577:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804586:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833116.804594:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833116.804600:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833116.804641:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804648:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833116.804685:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804692:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea421dd200/0x8c08e876ed3fea8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3fea96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804726:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833116.804728:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833116.804730:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833116.804745:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265878144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833116.804783:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833116.804832:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265878144 00000100:00100000:2.0:1788833116.804838:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265878144 00010000:00010000:2.0:1788833116.804860:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 17 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833116.804883:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788833116.804889:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3279:x1875727265878144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833116.804901:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833116.804907:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 17 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804918:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 17 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833116.804938:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833116.804968:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3279:x1875727265878144:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833116.804974:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788833116.805259:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265878144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788833116.805506:0:11633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477a00/0x8c08e876ed3fea96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3fea8f expref: 16 pid: 5804 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.805537:0:11633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877504:0@lo:104: 00000100:00100000:0.0:1788833116.814664:0:11633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265877888:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833116.814686:0:11633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11633:1875727265878016:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833116.814947:0:11633:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833116.822230:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833116.824127:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833116.835207:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256408832 00000100:00100000:2.0:1788833116.835229:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256408832 00010000:00010000:2.0:1788833116.835297:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 13 pid: 5807 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833116.835523:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256408960 00000100:00100000:2.0:1788833116.835529:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256408960 00010000:00010000:2.0:1788833116.835546:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 14 pid: 5806 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833116.835585:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:0.0:1788833116.835598:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+14:2358:x1875727256408832:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833116.835616:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833116.835622:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 14 pid: 5807 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.835635:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 14 pid: 5807 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.835657:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32476600/0x8c08e876ed3fea88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae0d expref: 14 pid: 5807 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.835685:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833116.835978:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256408832:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 380us (13762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833116.835987:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:0.0:1788833116.836013:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:0.0:1788833116.836020:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:2357:x1875727256408960:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833116.836065:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833116.836082:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836154:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836168:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea00031200/0x8c08e876ed3fea81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae06 expref: 12 pid: 5806 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836183:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836192:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836209:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836216:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836223:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836229:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836235:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477e00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833116.836239:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836247:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836268:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836281:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833116.836306:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:2357:x1875727256408960:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 285us (12191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833116.836313:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00010000:00010000:0.0:1788833116.836360:0:11633:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836433:0:11633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833116.836442:0:11633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febe6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833116.878720:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833116.878773:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833116.878838:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833116.878881:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409088 00000100:00100000:3.0:1788833116.878894:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409088 00000100:00100000:2.0:1788833116.878956:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409216 00000100:00100000:2.0:1788833116.878962:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409216 00000100:00100000:3.0:1788833116.878975:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409344 00000100:00100000:3.0:1788833116.878980:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409344 00000100:00100000:3.0:1788833116.879023:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:2.0:1788833116.879054:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:2.0:1788833116.879068:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256409216:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833116.879126:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256409088:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833116.879290:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 95 00000100:00100000:0.0:1788833116.879301:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256409344:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833116.879356:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256409216:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 291us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833116.879365:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00080000:2.0:1788833116.879412:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833116.879417:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833116.880895:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256409088:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 1766us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833116.880910:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:0.0:1788833116.884886:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256409344:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 5566us (6092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833116.884907:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 95 00010000:00010000:2.0:1788833117.165190:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833117.805855:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265878400:0@lo:400:kworker.0 00000100:00100000:1.0:1788833117.805945:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833117.806021:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265878912:0@lo:400:kworker.0 00000100:00100000:1.0:1788833117.806287:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833117.806326:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788833117.806332:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265878272:0@lo:400:kworker.0 00000100:00100000:1.0:1788833117.806360:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833117.806392:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265878784:0@lo:400:kworker.0 00000100:00100000:1.0:1788833117.806471:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833117.806501:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265878912 00000100:00100000:1.0:1788833117.806508:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265878912 00000100:00100000:1.0:1788833117.806563:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788833117.806572:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265878912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833117.806620:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265878912:12345-0@lo:400:kworker.0 Request processed in 49us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833117.806627:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788833117.806786:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265878528:0@lo:400:kworker.0 00000100:00100000:3.0:1788833117.806831:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833117.806853:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788833117.806859:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265878656:0@lo:400:kworker.0 00000100:00100000:3.0:1788833117.806880:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833117.806991:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265878656 00000100:00100000:3.0:1788833117.806996:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265878656 00000100:00100000:3.0:1788833117.807192:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788833117.807203:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875727265878656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833117.807242:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875727265878656:12345-0@lo:400:kworker.0 Request processed in 43us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833117.807247:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788833117.807282:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265878656:0@lo:400:kworker.0 00010000:00080000:3.0:1788833117.807475:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc47800 x1875727265878912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833117.807485:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265878912:0@lo:400:kworker.0 00000100:00100000:1.0:1788833117.807545:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265878272 00000100:00100000:1.0:1788833117.807550:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265878272 00000100:00100000:1.0:1788833117.807577:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788833117.807584:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3277:x1875727265878272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833117.807623:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3277:x1875727265878272:12345-0@lo:400:kworker.0 Request processed in 39us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833117.807629:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788833117.807780:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265878400 00000100:00100000:2.0:1788833117.807788:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265878400 00000100:00100000:2.0:1788833117.807827:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265878784 00000100:00100000:2.0:1788833117.807831:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265878784 00000100:00100000:2.0:1788833117.807846:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265878528 00000100:00100000:2.0:1788833117.807848:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265878528 00000100:00100000:2.0:1788833117.807863:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788833117.807868:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265878400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833117.807904:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265878400:12345-0@lo:400:kworker.0 Request processed in 36us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833117.807917:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788833117.807929:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788833117.807947:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265878784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833117.807989:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265878784:12345-0@lo:400:kworker.0 Request processed in 43us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833117.807995:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788833117.808008:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788833117.808014:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265878528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833117.808071:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265878528:12345-0@lo:400:kworker.0 Request processed in 58us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833117.808078:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788833117.808094:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788833117.808238:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833117.808287:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265878528:0@lo:400:kworker.0 00000100:00100000:2.0:1788833117.808328:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265878272:0@lo:400:kworker.0 00000100:00100000:2.0:1788833117.808338:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265878784:0@lo:400:kworker.0 00000100:00100000:2.0:1788833117.808347:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265878400:0@lo:400:kworker.0 00000100:00100000:3.0:1788833118.029251:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833118.029343:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409472 00000100:00100000:2.0:1788833118.029353:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409472 00000100:00100000:2.0:1788833118.029411:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 247 00000100:00100000:2.0:1788833118.029420:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:5599:x1875727256409472:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833118.029436:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833118.029455:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea1f036200/0x8c08e876ed3febed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae5a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833118.029481:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f036200/0x8c08e876ed3febed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae5a expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833118.029512:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea1f036200/0x8c08e876ed3febed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae5a expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833118.029522:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036200, rc 0) 00000100:00100000:2.0:1788833118.029581:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256409472:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 161us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833118.029588:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 247 00000100:00100000:2.0:1788833118.037315:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833118.037662:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409600 00000100:00100000:1.0:1788833118.037672:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409600 00000100:00100000:1.0:1788833118.037735:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 248 00000100:00100000:1.0:1788833118.037745:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256409600:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.038135:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256409600:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 390us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.038154:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 248 00000100:00100000:1.0:1788833118.042443:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833118.042541:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409728 00000100:00100000:0.0:1788833118.042550:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409728 00000100:00100000:0.0:1788833118.042605:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 249 00000100:00100000:0.0:1788833118.042616:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256409728:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.042917:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256409728:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 302us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.042932:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 249 00000100:00100000:1.0:1788833118.049820:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833118.051254:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409856 00000100:00100000:2.0:1788833118.051268:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409856 00000100:00100000:2.0:1788833118.051333:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 250 00000100:00100000:2.0:1788833118.051344:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:9955:x1875727256409856:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788833118.051590:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:9955:x1875727256409856:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 248us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833118.051599:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 250 00000100:00100000:2.0:1788833118.054845:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833118.056925:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256409984 00000100:00100000:1.0:1788833118.056945:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256409984 00000100:00100000:1.0:1788833118.057194:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 251 00000100:00100000:1.0:1788833118.057207:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:9955:x1875727256409984:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833118.057730:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:9955:x1875727256409984:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 523us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.057739:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 251 00000100:00100000:1.0:1788833118.060846:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833118.061566:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256410112 00000100:00100000:0.0:1788833118.061580:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256410112 00000100:00100000:0.0:1788833118.061657:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 252 00000100:00100000:0.0:1788833118.061670:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:5599:x1875727256410112:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833118.061689:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833118.061707:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.061737:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae61 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.061748:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae61 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.061758:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477e00, rc 0) 00000100:00100000:0.0:1788833118.061837:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256410112:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 169us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.061844:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 252 00000100:00100000:3.0:1788833118.073342:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833118.073638:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256410240 00000100:00100000:1.0:1788833118.073828:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256410240 00000100:00100000:1.0:1788833118.073904:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 253 00000100:00100000:1.0:1788833118.073914:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256410240:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.074590:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256410240:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 672us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.074599:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 253 00000100:00100000:1.0:1788833118.080338:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833118.089792:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256410368 00000100:00100000:2.0:1788833118.089829:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256410368 00000100:00100000:2.0:1788833118.089938:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 254 00000100:00100000:2.0:1788833118.089951:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256410368:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833118.090299:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:5599:x1875727256410368:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 350us (9976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833118.090309:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 254 00000100:00100000:2.0:1788833118.093721:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833118.096314:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256410496 00000100:00100000:1.0:1788833118.096333:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256410496 00000100:00100000:1.0:1788833118.096480:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 255 00000100:00100000:1.0:1788833118.096492:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:9958:x1875727256410496:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833118.097542:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea07d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:9958:x1875727256410496:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 1045us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.097566:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 255 00000100:00100000:3.0:1788833118.102724:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833118.103150:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256410624 00000100:00100000:0.0:1788833118.103162:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256410624 00000100:00100000:0.0:1788833118.103231:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 256 00000100:00100000:0.0:1788833118.103242:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:9958:x1875727256410624:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833118.103557:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:9958:x1875727256410624:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 316us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.103567:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 256 00010000:00010000:2.0:1788833118.189252:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833118.317561:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788833118.317591:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265879040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833118.317678:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833118.317790:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879040 00000100:00100000:0.0:1788833118.317799:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879040 00000100:00100000:0.0:1788833118.317867:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788833118.317878:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265879040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833118.317923:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833118.317984:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265879040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.317992:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788833118.318667:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc45c00 x1875727265879040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833118.318691:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265879040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833118.321728:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265879168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833118.321947:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.322690:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879168 00000100:00100000:1.0:1788833118.322702:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879168 00000100:00100000:1.0:1788833118.322916:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788833118.322930:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875727265879168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833118.322990:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788833118.323696:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833118.331156:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875727265879168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8216us (9196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.331174:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788833118.331681:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265879168:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788833118.445233:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788833118.445243:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea06626000 from 7 10000000:01000000:0.0:1788833118.445250:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788833118.445319:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.445333:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.445347:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833118.445410:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.445525:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833118.445621:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07f0b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788833118.446117:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879296 00000100:00100000:2.0:1788833118.446127:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879296 00000100:00100000:2.0:1788833118.446196:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788833118.446209:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:5809:x1875727265879296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833118.446315:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833118.446338:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea1f037e00/0x8c08e876ed3fec02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3febfb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833118.446373:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f037e00/0x8c08e876ed3fec02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3febfb expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833118.446398:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea1f037e00/0x8c08e876ed3fec02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3febfb expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833118.446408:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037e00, rc 0) 00000100:00100000:2.0:1788833118.446483:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265879296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833118.446491:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788833118.446613:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833118.446633:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.446644:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833118.446728:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.446778:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.446826:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833118.446926:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879424 00000100:00100000:2.0:1788833118.446930:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879424 00000100:00100000:2.0:1788833118.446963:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788833118.446980:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265879424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833118.447946:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265879424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 962us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833118.447956:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788833118.448314:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.448370:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.448430:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.448516:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833118.448603:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879552 00000100:00100000:2.0:1788833118.448610:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879552 00000100:00100000:2.0:1788833118.448692:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788833118.448709:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265879552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833118.448943:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265879552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833118.448950:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788833118.449068:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.454774:0:11646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11646:1875727265879680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833118.454928:0:11646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.455012:0:11646:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405240 going to sleep for 11 seconds 00000100:00100000:3.0:1788833118.455062:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879680 00000100:00100000:3.0:1788833118.455073:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879680 00000100:00100000:3.0:1788833118.455166:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788833118.455180:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:11646:x1875727265879680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833118.455514:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0681a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:11646:x1875727265879680:12345-0@lo:502:llog_process_th.0 Request processed in 336us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833118.455521:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788833118.455970:0:11646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11646:1875727265879680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788833118.456241:0:11646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833118.456254:0:11646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833118.456257:0:11646:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788833118.456265:0:11646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cea06626000 00000020:00000080:1.0:1788833118.456268:0:11646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788833118.456561:0:11646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11646:1875727265879808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833118.456645:0:11646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.456686:0:11646:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405240 going to sleep for 11 seconds 00000100:00100000:0.0:1788833118.456753:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879808 00000100:00100000:0.0:1788833118.456763:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879808 00000100:00100000:0.0:1788833118.456821:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788833118.456830:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:11646:x1875727265879808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833118.457105:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:11646:x1875727265879808:12345-0@lo:502:llog_process_th.0 Request processed in 275us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.457113:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788833118.457540:0:11646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11646:1875727265879808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788833118.457572:0:11646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833118.457579:0:11646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833118.457581:0:11646:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788833118.457586:0:11646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788833118.457853:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788833118.457873:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788833118.457885:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.457898:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833118.457911:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788833118.457914:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea1fc5c800 from 7 10000000:01000000:0.0:1788833118.457917:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788833118.457952:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.457960:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.457971:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833118.457999:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.458097:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833118.458129:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07f0b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788833118.458702:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265879936 00000100:00100000:1.0:1788833118.458711:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265879936 00000100:00100000:1.0:1788833118.458762:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788833118.458772:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:5809:x1875727265879936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833118.458787:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833118.458814:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932f000/0x8c08e876ed3fec10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fec09 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.458847:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932f000/0x8c08e876ed3fec10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fec09 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.458878:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932f000/0x8c08e876ed3fec10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fec09 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.458889:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f000, rc 0) 00000100:00100000:1.0:1788833118.458946:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265879936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.458953:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788833118.459358:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265879936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833118.459378:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.459390:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833118.459463:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.459510:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.460466:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880064 00000100:00100000:0.0:1788833118.461828:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07f0b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788833118.461916:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880064 00000100:00100000:0.0:1788833118.463726:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788833118.463756:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265880064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.464173:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265880064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 431us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.464182:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788833118.464255:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.464317:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.464368:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833118.464700:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07f0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788833118.464724:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880192 00000100:00100000:0.0:1788833118.464731:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880192 00000100:00100000:0.0:1788833118.464776:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788833118.464787:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265880192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.465001:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265880192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.465008:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788833118.467070:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833118.470946:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11648:1875727265880320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833118.471115:0:11648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833118.471164:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea101d50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833118.471203:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880320 00000100:00100000:1.0:1788833118.471212:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880320 00000100:00100000:1.0:1788833118.471280:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788833118.471291:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:11648:x1875727265880320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833118.471604:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:11648:x1875727265880320:12345-0@lo:502:llog_process_th.0 Request processed in 313us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.471612:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788833118.471639:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11648:1875727265880320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788833118.471672:0:11648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788833118.471684:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833118.471687:0:11648:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788833118.471694:0:11648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cea1fc5c800 00000020:00000080:3.0:1788833118.471697:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788833118.471812:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11648:1875727265880448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833118.471852:0:11648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833118.471875:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea101d50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833118.471944:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880448 00000100:00100000:1.0:1788833118.471950:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880448 00000100:00100000:1.0:1788833118.471992:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788833118.471999:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:11648:x1875727265880448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833118.472417:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:11648:x1875727265880448:12345-0@lo:502:llog_process_th.0 Request processed in 417us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.472426:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788833118.472935:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea269cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11648:1875727265880448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788833118.472966:0:11648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788833118.472974:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788833118.472976:0:11648:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788833118.472994:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788833118.473434:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788833118.473458:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788833118.473471:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.473504:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833118.473516:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788833118.473744:0:5809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea100dd800 from 7 10000000:01000000:1.0:1788833118.473749:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788833118.473788:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.473798:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.473822:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833118.473846:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.473905:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.473947:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833118.473973:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880576 00000100:00100000:1.0:1788833118.473992:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880576 00000100:00100000:1.0:1788833118.474189:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788833118.474201:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:5809:x1875727265880576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833118.474215:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833118.474230:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932e200/0x8c08e876ed3fec1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3fec17 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.474257:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932e200/0x8c08e876ed3fec1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3fec17 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.474285:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932e200/0x8c08e876ed3fec1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3fec17 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.474296:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e200, rc 0) 00000100:00100000:1.0:1788833118.474337:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265880576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.474344:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788833118.474450:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833118.474464:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833118.474474:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833118.474752:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.474784:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833118.474823:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833118.474841:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880704 00000100:00100000:1.0:1788833118.474845:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880704 00000100:00100000:1.0:1788833118.474866:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788833118.474873:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265880704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833118.477159:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265880704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2275us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833118.477174:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788833118.479090:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.479174:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.479268:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833118.479317:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abe540 going to sleep for 11 seconds 00000100:00100000:3.0:1788833118.479549:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880832 00000100:00100000:3.0:1788833118.479558:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880832 00000100:00100000:3.0:1788833118.479632:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788833118.479655:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265880832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833118.479933:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:5809:x1875727265880832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833118.479942:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788833118.480203:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:5809:1875727265880832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833118.481987:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11649:1875727265880960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833118.482208:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833118.482303:0:11649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833118.489138:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265880960 00000100:00100000:1.0:1788833118.489160:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265880960 00000100:00100000:0.0:1788833118.489511:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788833118.489527:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:11649:x1875727265880960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833118.490582:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:11649:x1875727265880960:12345-0@lo:502:llog_process_th.0 Request processed in 1055us (8369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833118.490594:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788833118.490913:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11649:1875727265880960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788833118.490961:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833118.490973:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833118.490975:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788833118.490993:0:11649:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cea100dd800 00000020:00000080:1.0:1788833118.490997:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788833118.491564:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11649:1875727265881088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833118.491751:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833118.491813:0:11649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088ef300 going to sleep for 11 seconds 00000100:00100000:2.0:1788833118.491829:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881088 00000100:00100000:2.0:1788833118.491843:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881088 00000100:00100000:2.0:1788833118.491904:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788833118.491915:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:11649:x1875727265881088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833118.492181:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:11649:x1875727265881088:12345-0@lo:502:llog_process_th.0 Request processed in 267us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833118.492190:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788833118.492315:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:11649:1875727265881088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788833118.492448:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833118.492457:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833118.492459:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788833118.492475:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788833118.493747:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788833118.493792:0:5809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788833118.493815:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833118.493832:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788833118.498488:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788833119.215402:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788833119.534340:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788833120.237228:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833121.263072:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788833121.446387:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1788833121.995874:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833121.995926:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833121.995967:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833121.995991:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256410880 00000100:00100000:2.0:1788833121.996002:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256410880 00000100:00100000:3.0:1788833121.996007:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00080000:3.0:1788833121.996078:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833121.996100:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411136 00000100:00100000:2.0:1788833121.996105:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411136 00000100:00100000:3.0:1788833121.996115:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 99 00000100:00100000:3.0:1788833121.996133:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea269cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256410880:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833121.996156:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:2.0:1788833121.996167:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256411136:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833121.996207:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea269cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256410880:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 82us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833121.996217:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 99 00000100:00080000:3.0:1788833121.996298:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833121.996389:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256411136:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 53us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833121.996396:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:1.0:1788833121.996547:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411008 00000100:00100000:1.0:1788833121.996552:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411008 00000100:00100000:1.0:1788833121.996606:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:1.0:1788833121.996614:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256411008:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833121.996655:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256411008:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 42us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833121.996662:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00080000:3.0:1788833121.996941:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833121.997027:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256410752 00000100:00100000:0.0:1788833121.997061:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256410752 00000100:00100000:0.0:1788833121.997100:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 272 00000100:00100000:0.0:1788833121.997108:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256410752:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833121.997150:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256410752:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 43us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833121.997157:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 272 00010000:00010000:2.0:1788833122.285338:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833122.925357:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265881344:0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925422:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833122.925472:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925498:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833122.925527:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788833122.925533:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265881216:0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925560:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833122.925583:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265881728:0@lo:400:kworker.0 00000100:00100000:1.0:1788833122.925595:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881216 00000100:00100000:2.0:1788833122.925603:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833122.925603:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881216 00000100:00100000:2.0:1788833122.925647:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265881600:0@lo:400:kworker.0 00000100:00100000:1.0:1788833122.925647:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788833122.925656:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265881216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925683:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833122.925700:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833122.925702:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265881216:12345-0@lo:400:kworker.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833122.925705:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265881472:0@lo:400:kworker.0 00000100:00100000:1.0:1788833122.925709:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788833122.925726:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833122.925748:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881856 00000100:00100000:2.0:1788833122.925751:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881856 00000100:00100000:1.0:1788833122.925754:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265881216:0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925797:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881600 00000100:00100000:2.0:1788833122.925801:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881600 00000100:00100000:1.0:1788833122.925803:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788833122.925809:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265881856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925823:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788833122.925828:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265881600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833122.925843:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265881856:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833122.925862:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788833122.925872:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265881600:12345-0@lo:400:kworker.0 Request processed in 44us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833122.925877:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788833122.925893:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea066cdc00 x1875727265881856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833122.925897:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788833122.925901:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea05caad80, transno 4294967300 00000100:00100000:1.0:1788833122.925903:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925909:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265881600:0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.925934:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881344 00000100:00100000:2.0:1788833122.925938:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881344 00000100:00100000:2.0:1788833122.925968:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881728 00000100:00100000:2.0:1788833122.925971:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881728 00000100:00100000:2.0:1788833122.925983:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881472 00000100:00100000:2.0:1788833122.925985:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881472 00000100:00100000:2.0:1788833122.925998:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788833122.926003:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265881344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833122.926050:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788833122.926053:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265881344:12345-0@lo:400:kworker.0 Request processed in 50us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833122.926058:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265881728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.926059:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788833122.926069:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788833122.926074:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265881472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833122.926086:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265881728:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833122.926092:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788833122.926098:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265881472:12345-0@lo:400:kworker.0 Request processed in 24us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833122.926103:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788833122.926117:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265881728:0@lo:400:kworker.0 00000100:00100000:2.0:1788833122.926120:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265881472:0@lo:400:kworker.0 00000100:00100000:1.0:1788833122.926126:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265881344:0@lo:400:kworker.0 00000100:00080000:3.0:1788833122.926446:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788833122.926452:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833122.926454:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788833123.309272:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833123.437708:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833123.437733:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265881984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833123.437820:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833123.437966:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265881984 00000100:00100000:0.0:1788833123.437973:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265881984 00000100:00100000:0.0:1788833123.438024:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788833123.438053:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265881984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833123.438086:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833123.438273:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265881984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 239us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833123.438281:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788833123.438384:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc47800 x1875727265881984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833123.438403:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265881984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833123.438423:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265882112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833123.438459:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833123.444573:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265882112 00000100:00100000:0.0:1788833123.444589:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265882112 00000100:00100000:0.0:1788833123.444655:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788833123.444666:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265882112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788833123.444717:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833123.444824:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265882112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (6362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833123.444831:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788833123.444948:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265882112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788833124.333388:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833125.357199:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833126.381214:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833127.119541:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833127.119589:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833127.119643:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833127.119684:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411392 00000100:00100000:3.0:1788833127.119685:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833127.119700:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411392 00000100:00100000:3.0:1788833127.119732:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411520 00000100:00100000:3.0:1788833127.119742:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411520 00000100:00100000:2.0:1788833127.119805:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411648 00000100:00100000:2.0:1788833127.119811:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411648 00000100:00100000:3.0:1788833127.119826:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:2.0:1788833127.119854:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 104 00000100:00100000:3.0:1788833127.119863:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256411520:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833127.119874:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256411392:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833127.120003:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256411520:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 163us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833127.120012:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411264 00000100:00100000:3.0:1788833127.120018:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:0.0:1788833127.120020:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411264 00000100:00080000:3.0:1788833127.120086:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833127.120093:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833127.120106:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 274 00000100:00100000:3.0:1788833127.120117:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 105 00000100:00100000:3.0:1788833127.120133:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256411648:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833127.120138:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256411264:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833127.120903:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256411392:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 1031us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833127.120913:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 104 00000100:00100000:0.0:1788833127.121274:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256411264:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 1142us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833127.121281:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 274 00000100:00100000:3.0:1788833127.126435:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256411648:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 6286us (6825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833127.126455:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 105 00010000:00010000:2.0:1788833127.405216:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833128.051071:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265882240:0@lo:400:kworker.0 00000100:00100000:2.0:1788833128.052548:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833128.052715:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265882624:0@lo:400:kworker.0 00000100:00100000:1.0:1788833128.052787:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833128.052849:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833128.052855:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265882496:0@lo:400:kworker.0 00000100:00100000:1.0:1788833128.052899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833128.052929:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265882496 00000100:00100000:1.0:1788833128.052936:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265882496 00000100:00100000:1.0:1788833128.053001:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788833128.053010:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265882496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833128.053078:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265882496:12345-0@lo:400:kworker.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833128.053084:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788833128.053140:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265882496:0@lo:400:kworker.0 00000100:00080000:3.0:1788833128.054592:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833128.054627:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265882368:0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.054688:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833128.054741:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265882880:0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.054775:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833128.054799:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788833128.054806:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265882752:0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.054828:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833128.054862:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265882624 00000100:00100000:3.0:1788833128.054870:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265882624 00000100:00100000:3.0:1788833128.054918:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265882880 00000100:00100000:3.0:1788833128.054921:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265882880 00000100:00100000:3.0:1788833128.054942:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788833128.054960:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265882624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.055023:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265882624:12345-0@lo:400:kworker.0 Request processed in 74us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833128.055069:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788833128.055085:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788833128.055093:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265882880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.055127:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265882880:12345-0@lo:400:kworker.0 Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833128.055132:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788833128.055149:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265882368 00000100:00100000:3.0:1788833128.055152:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265882368 00000100:00100000:3.0:1788833128.055177:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265882752 00000100:00100000:3.0:1788833128.055180:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265882752 00000100:00100000:3.0:1788833128.055199:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788833128.055206:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265882368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.055250:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265882368:12345-0@lo:400:kworker.0 Request processed in 45us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833128.055256:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788833128.055268:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788833128.055275:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265882752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.055300:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265882752:12345-0@lo:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833128.055306:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788833128.055322:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788833128.055326:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833128.055328:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833128.055357:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265882752:0@lo:400:kworker.0 00000100:00100000:3.0:1788833128.055368:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265882368:0@lo:400:kworker.0 00000100:00100000:2.0:1788833128.056192:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265882624:0@lo:400:kworker.0 00010000:00080000:3.0:1788833128.057499:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea066cdc00 x1875727265882880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833128.057512:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265882880:0@lo:400:kworker.0 00000100:00100000:0.0:1788833128.058211:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265882240 00000100:00100000:0.0:1788833128.058220:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265882240 00000100:00100000:0.0:1788833128.058275:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788833128.058285:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265882240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833128.058372:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265882240:12345-0@lo:400:kworker.0 Request processed in 88us (5830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833128.058390:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788833128.058594:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265882240:0@lo:400:kworker.0 00010000:00010000:2.0:1788833128.429411:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833128.558386:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833128.558407:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265883008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833128.558481:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833128.558781:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883008 00000100:00100000:1.0:1788833128.558788:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883008 00000100:00100000:1.0:1788833128.558839:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788833128.558848:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265883008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833128.558882:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833128.558924:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265883008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833128.558930:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788833128.559049:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788833128.559069:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265883136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833128.559099:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833128.559334:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883136 00000100:00100000:1.0:1788833128.559339:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883136 00000100:00100000:1.0:1788833128.559370:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788833128.559376:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265883136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833128.559397:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833128.559435:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265883136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833128.559452:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788833128.559598:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265883136:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788833128.560125:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc45880 x1875727265883008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833128.560141:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265883008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788833129.453420:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788833129.773793:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788833130.477555:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833131.501356:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833132.239858:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833132.239934:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833132.240077:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411776 00000100:00100000:0.0:1788833132.240092:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411776 00000100:00100000:0.0:1788833132.240169:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 276 00000100:00100000:0.0:1788833132.240181:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256411776:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833132.240282:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256411776:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833132.240290:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 276 00000100:00100000:3.0:1788833132.240917:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256411904 00000100:00100000:3.0:1788833132.240924:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256411904 00000100:00100000:3.0:1788833132.240992:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 109 00000100:00100000:3.0:1788833132.241019:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256411904:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833132.241115:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256411904:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 114us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833132.241122:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 109 00000100:00080000:2.0:1788833132.242537:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833132.256510:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833132.256629:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833132.256778:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412160 00000100:00100000:2.0:1788833132.256792:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412160 00000100:00100000:2.0:1788833132.256904:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 110 00000100:00100000:2.0:1788833132.256916:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256412160:12345-192.168.206.55@tcp:400:kworker.0 00000100:00080000:0.0:1788833132.257315:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833132.257409:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256412160:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 493us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833132.257434:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 110 00000100:00100000:3.0:1788833132.258155:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412032 00000100:00100000:3.0:1788833132.258167:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412032 00000100:00100000:3.0:1788833132.258261:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:3.0:1788833132.258274:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2356:x1875727256412032:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:3.0:1788833132.258317:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3feb5a 00000100:00080000:3.0:1788833132.258330:0:6656:0:(import.c:65:import_set_state_nolock()) ffff9cea4096d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788833132.258384:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788833132.258744:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+2:2356:x1875727256412032:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 460us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833132.258754:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00010000:00010000:2.0:1788833132.258871:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788833132.258939:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788833132.525260:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833133.165445:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265883520:0@lo:400:kworker.0 00000100:00100000:0.0:1788833133.165545:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833133.165641:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788833133.165648:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265883648:0@lo:400:kworker.0 00000100:00100000:0.0:1788833133.165680:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833133.165786:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265883264:0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.165828:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833133.165865:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0352b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265883776:0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.165889:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833133.165911:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788833133.165916:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265883392:0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.165936:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833133.165949:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0352a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265883904:0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.166072:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833133.166114:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883648 00000100:00100000:2.0:1788833133.166123:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883648 00000100:00100000:2.0:1788833133.166198:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883904 00000100:00100000:2.0:1788833133.166202:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883904 00000100:00100000:2.0:1788833133.166230:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833133.166239:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265883648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.166300:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265883648:12345-0@lo:400:kworker.0 Request processed in 62us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833133.166308:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833133.166328:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788833133.166335:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265883904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.166365:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265883904:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833133.166388:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788833133.166409:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883520 00000100:00100000:2.0:1788833133.166413:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883520 00000100:00100000:2.0:1788833133.166440:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883776 00000100:00100000:2.0:1788833133.166443:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883776 00000100:00100000:2.0:1788833133.166455:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883392 00000100:00100000:2.0:1788833133.166457:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883392 00000100:00100000:2.0:1788833133.166467:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788833133.166472:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265883520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.166506:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265883520:12345-0@lo:400:kworker.0 Request processed in 34us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833133.166512:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788833133.166521:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788833133.166526:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265883776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.166549:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265883776:12345-0@lo:400:kworker.0 Request processed in 23us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833133.166554:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788833133.166563:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788833133.166568:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265883392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.166591:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265883392:12345-0@lo:400:kworker.0 Request processed in 24us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833133.166596:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788833133.166623:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788833133.166629:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833133.166631:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833133.169157:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265883264 00000100:00100000:0.0:1788833133.169176:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265883264 00000100:00100000:0.0:1788833133.169260:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788833133.169272:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265883264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833133.169385:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265883264:12345-0@lo:400:kworker.0 Request processed in 115us (3557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833133.169394:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788833133.169484:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265883648:0@lo:400:kworker.0 00000100:00100000:0.0:1788833133.169501:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265883520:0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.171380:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265883392:0@lo:400:kworker.0 00010000:00080000:2.0:1788833133.171436:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea0352a680 x1875727265883904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833133.171449:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0352a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265883904:0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.171461:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265883264:0@lo:400:kworker.0 00000100:00100000:2.0:1788833133.171474:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0352b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265883776:0@lo:400:kworker.0 00010000:00010000:2.0:1788833133.549249:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833133.678529:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265884032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833133.678626:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833133.678816:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884032 00000100:00100000:1.0:1788833133.678828:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884032 00000100:00100000:1.0:1788833133.678888:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788833133.678898:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265884032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833133.678943:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833133.679005:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265884032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833133.679014:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788833133.679205:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc45880 x1875727265884032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833133.679228:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265884032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833133.679508:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265884160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833133.679567:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833133.679655:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884160 00000100:00100000:1.0:1788833133.679660:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884160 00000100:00100000:1.0:1788833133.679694:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788833133.679701:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265884160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833133.679736:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833133.679782:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265884160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833133.679789:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788833133.679890:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265884160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788833134.573535:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833135.597297:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833136.621215:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788833136.799274:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:3.0:1788833136.799283:0:6679:0:(genops.c:885:class_export_put()) final put ffff9cea4096e800/458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:2.0:1788833136.799358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea4096e800/458534c2-c478-4b32-bcda-93b4ecf625e9 for lustre-OST0000 00000020:00000080:2.0:1788833136.799423:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea4096d000 for lustre-OST0000 00000100:00100000:1.0:1788833137.359415:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833137.359473:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833137.359488:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412288 00000100:00100000:2.0:1788833137.359501:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412288 00000100:00100000:1.0:1788833137.359516:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833137.359563:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 278 00000100:00100000:2.0:1788833137.359575:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256412288:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833137.359665:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256412288:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833137.360806:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412544 00000100:00100000:3.0:1788833137.360820:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412544 00000100:00100000:3.0:1788833137.360893:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412416 00000100:00100000:3.0:1788833137.360898:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412416 00000100:00100000:3.0:1788833137.360949:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 114 00000100:00100000:3.0:1788833137.360961:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256412544:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833137.361064:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256412544:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 106us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833137.361073:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 114 00000100:00100000:3.0:1788833137.361094:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:3.0:1788833137.361104:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256412416:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833137.361130:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256412416:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 31us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833137.361136:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:2.0:1788833137.368991:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 278 00000100:00080000:2.0:1788833137.369097:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788833137.647150:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833138.294486:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265884288:0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.294578:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833138.294751:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884288 00000100:00100000:1.0:1788833138.294761:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884288 00000100:00100000:1.0:1788833138.294826:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788833138.294837:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265884288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833138.303695:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265884288:12345-0@lo:400:kworker.0 Request processed in 8847us (9104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833138.303740:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788833138.304101:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265884288:0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.304136:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833138.304151:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265884416:0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.304215:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833138.304297:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884416 00000100:00100000:2.0:1788833138.304306:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884416 00000100:00100000:2.0:1788833138.304354:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788833138.304363:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265884416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.304421:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265884416:12345-0@lo:400:kworker.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833138.304428:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788833138.304459:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265884416:0@lo:400:kworker.0 00000100:00100000:3.0:1788833138.305747:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788833138.305768:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265884544:0@lo:400:kworker.0 00000100:00100000:3.0:1788833138.305834:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833138.305894:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265884672:0@lo:400:kworker.0 00000100:00100000:3.0:1788833138.305923:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833138.305957:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884672 00000100:00100000:3.0:1788833138.306270:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884672 00000100:00100000:3.0:1788833138.306349:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788833138.306377:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265884672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833138.306437:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265884672:12345-0@lo:400:kworker.0 Request processed in 80us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833138.306444:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788833138.306688:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884544 00000100:00100000:1.0:1788833138.306693:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884544 00000100:00100000:1.0:1788833138.306744:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788833138.306752:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265884544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833138.306792:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265884544:12345-0@lo:400:kworker.0 Request processed in 41us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833138.306799:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1788833138.307115:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833138.307122:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833138.307164:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265884672:0@lo:400:kworker.0 00000100:00100000:3.0:1788833138.307175:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265884544:0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.307331:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265884800:0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.307379:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833138.307415:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833138.307421:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265884928:0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.307450:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833138.307555:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884928 00000100:00100000:2.0:1788833138.307561:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884928 00000100:00100000:2.0:1788833138.307604:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788833138.307611:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265884928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833138.307651:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265884928:12345-0@lo:400:kworker.0 Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833138.307676:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788833138.307725:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea1fd5d880 x1875727265884928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833138.307738:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265884928:0@lo:400:kworker.0 00000100:00080000:3.0:1788833138.308714:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833138.308737:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265884800 00000100:00100000:3.0:1788833138.308746:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265884800 00000100:00100000:3.0:1788833138.308868:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788833138.308880:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265884800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833138.308976:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265884800:12345-0@lo:400:kworker.0 Request processed in 100us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833138.308984:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788833138.309051:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265884800:0@lo:400:kworker.0 00000100:00080000:2.0:1788833138.314335:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788833138.671576:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833138.798260:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833138.798291:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265885056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833138.798381:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833138.798547:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885056 00000100:00100000:2.0:1788833138.798557:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885056 00000100:00100000:2.0:1788833138.798687:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788833138.798708:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265885056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833138.798756:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833138.798811:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265885056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833138.798820:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788833138.798870:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea39559f80 x1875727265885056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833138.798891:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265885056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833138.802203:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833138.802231:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265885184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833138.802321:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833138.802393:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885184 00000100:00100000:1.0:1788833138.802402:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885184 00000100:00100000:1.0:1788833138.802459:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788833138.802470:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265885184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833138.802515:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833138.802565:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265885184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833138.802573:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788833138.802634:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265885184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788833139.693424:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788833140.013815:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788833140.717354:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833141.743517:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788833141.941664:0:11813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:05:39 (1788833139) 00000100:00100000:3.0:1788833142.479633:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833142.479704:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833142.479753:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833142.479758:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412800 00000100:00100000:1.0:1788833142.479784:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412800 00000100:00080000:3.0:1788833142.479842:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833142.479876:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412928 00000100:00100000:1.0:1788833142.479881:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412928 00000100:00100000:3.0:1788833142.479903:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 119 00000100:00100000:3.0:1788833142.479923:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256412800:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833142.479945:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:1.0:1788833142.479959:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256412928:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833142.480072:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256412800:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 115us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833142.480096:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 119 00000100:00100000:1.0:1788833142.480105:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256412928:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 145us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833142.480116:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00080000:3.0:1788833142.480255:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833142.480692:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256412672 00000100:00100000:2.0:1788833142.480701:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256412672 00000100:00100000:2.0:1788833142.480754:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 280 00000100:00100000:2.0:1788833142.480763:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256412672:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833142.480822:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256412672:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 60us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833142.480829:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 280 00010000:00010000:2.0:1788833142.765533:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833143.405594:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788833143.407744:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833143.407777:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265885440:0@lo:400:kworker.0 00000100:00100000:2.0:1788833143.407869:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833143.408471:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885440 00000100:00100000:3.0:1788833143.408482:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885440 00000100:00100000:3.0:1788833143.408557:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788833143.408569:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265885440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833143.408644:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265885440:12345-0@lo:400:kworker.0 Request processed in 77us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833143.408652:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788833143.408933:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265885440:0@lo:400:kworker.0 00000100:00100000:1.0:1788833143.411338:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265885312:0@lo:400:kworker.0 00000100:00100000:1.0:1788833143.411512:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833143.414025:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265885696:0@lo:400:kworker.0 00000100:00100000:0.0:1788833143.414153:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833143.414202:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788833143.414209:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265885568:0@lo:400:kworker.0 00000100:00100000:0.0:1788833143.414236:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833143.414665:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885568 00000100:00100000:1.0:1788833143.414683:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885568 00000100:00100000:1.0:1788833143.414784:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788833143.414797:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265885568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833143.414870:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265885568:12345-0@lo:400:kworker.0 Request processed in 77us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833143.414879:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788833143.414914:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265885952:0@lo:400:kworker.0 00000100:00100000:1.0:1788833143.414945:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833143.414967:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833143.414974:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265885824:0@lo:400:kworker.0 00000100:00100000:1.0:1788833143.414996:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833143.415072:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265885568:0@lo:400:kworker.0 00000100:00080000:0.0:1788833143.415614:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833143.415882:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885696 00000100:00100000:3.0:1788833143.415891:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885696 00000100:00100000:3.0:1788833143.415976:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885952 00000100:00100000:3.0:1788833143.415980:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885952 00000100:00100000:3.0:1788833143.416015:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788833143.416024:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265885696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833143.416149:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265885696:12345-0@lo:400:kworker.0 Request processed in 126us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833143.416156:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788833143.416175:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788833143.416181:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265885952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833143.416213:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265885952:12345-0@lo:400:kworker.0 Request processed in 33us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833143.416218:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788833143.416248:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885824 00000100:00100000:3.0:1788833143.416253:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885824 00000100:00080000:0.0:1788833143.416602:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788833143.416606:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788833143.416608:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833143.417504:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788833143.417525:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265885824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833143.417939:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265885824:12345-0@lo:400:kworker.0 Request processed in 421us (2940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833143.417947:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788833143.418106:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265885824:0@lo:400:kworker.0 00010000:00080000:1.0:1788833143.418270:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3fc47480 x1875727265885952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788833159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833143.418293:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265885952:0@lo:400:kworker.0 00000100:00100000:1.0:1788833143.418511:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265885696:0@lo:400:kworker.0 00000100:00100000:2.0:1788833143.419495:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265885312 00000100:00100000:2.0:1788833143.419506:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265885312 00000100:00100000:2.0:1788833143.419580:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788833143.419590:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265885312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833143.419702:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265885312:12345-0@lo:400:kworker.0 Request processed in 113us (8191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833143.420930:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265885312:0@lo:400:kworker.0 00000100:00100000:2.0:1788833143.421023:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788833143.631976:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833143.632277:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256413056 00000100:00100000:0.0:1788833143.632291:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256413056 00000100:00100000:0.0:1788833143.632367:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:0.0:1788833143.632378:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:10227:x1875727256413056:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833143.632402:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833143.632429:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476e00/0x8c08e876ed3fec25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae68 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.632694:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fec2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.632711:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fec2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.632727:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fec2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833143.632773:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833143.632778:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833143.632827:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fec2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.632857:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476e00/0x8c08e876ed3fec25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae68 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.632878:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fec2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae68 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.632888:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833143.632891:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833143.632910:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476400, rc 0) 00000100:00100000:0.0:1788833143.632988:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:10227:x1875727256413056:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 612us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833143.632997:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:3.0:1788833143.639458:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833143.639544:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256413184 00000100:00100000:0.0:1788833143.639558:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256413184 00000100:00100000:0.0:1788833143.639637:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:0.0:1788833143.639650:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:10228:x1875727256413184:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833143.639689:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833143.639716:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476e00/0x8c08e876ed3fec33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae6f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.639831:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.639979:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.639996:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640015:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640023:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640060:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640599:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477600/0x8c08e876ed3fec48 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640616:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477600/0x8c08e876ed3fec48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640625:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477600/0x8c08e876ed3fec48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833143.640659:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833143.640663:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833143.640695:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477600/0x8c08e876ed3fec48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640708:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640716:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640724:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.640730:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833143.640735:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641748:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641769:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833143.641772:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833143.641779:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641804:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641825:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641832:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641838:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641844:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833143.641911:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641975:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641986:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cea08db1500) 00010000:00010000:0.0:1788833143.641989:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833143.641992:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.641998:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.642631:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476e00/0x8c08e876ed3fec33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae6f expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.642652:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477600/0x8c08e876ed3fec48 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae6f expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833143.642690:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cea08db1000) 00010000:00010000:0.0:1788833143.642693:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833143.642696:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477600, rc 0) 00000100:00100000:0.0:1788833143.642844:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:10228:x1875727256413184:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 3194us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833143.642862:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:3.0:1788833143.655290:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833143.659948:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256413440 00000100:00100000:1.0:1788833143.659968:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256413440 00000100:00100000:1.0:1788833143.660647:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:1.0:1788833143.660665:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:10228:x1875727256413440:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833143.660702:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833143.660731:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3fec4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae76 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.663438:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.663476:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.663490:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.663710:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.663732:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.663745:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664131:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3fec64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664142:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3fec64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664161:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3fec64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833143.664672:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788833143.664860:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664868:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664875:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664881:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932e000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833143.664885:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664892:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664907:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cea08db1000) 00010000:00010000:1.0:1788833143.664910:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833143.664915:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664921:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fec56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664934:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664939:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664953:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664959:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833143.664961:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664967:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664976:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cea0884e900) 00010000:00010000:1.0:1788833143.664978:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833143.664981:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.664986:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fec5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.665548:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3fec4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae76 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.665564:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3fec64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae76 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833143.665571:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:1.0:1788833143.665573:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833143.665576:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f200, rc 0) 00000100:00100000:1.0:1788833143.665645:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+9:10228:x1875727256413440:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 4986us (10372us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788833143.665662:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:3.0:1788833143.672359:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833143.672790:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256413568 00000100:00100000:0.0:1788833143.672805:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256413568 00000100:00100000:0.0:1788833143.672904:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:0.0:1788833143.672917:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:10228:x1875727256413568:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788833143.673103:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:10228:x1875727256413568:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 Request processed in 188us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833143.673124:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 35 00010000:00010000:2.0:1788833143.790184:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833143.917607:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788833143.917636:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265886080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833143.917740:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833143.918069:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265886080 00000100:00100000:1.0:1788833143.918078:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265886080 00000100:00100000:1.0:1788833143.918133:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788833143.918143:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265886080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833143.918185:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833143.918239:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265886080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833143.918247:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788833143.918300:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265886080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833143.919324:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833143.919340:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3955b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265886208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833143.919391:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833143.919502:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265886208 00000100:00100000:1.0:1788833143.919508:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265886208 00000100:00100000:1.0:1788833143.919561:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788833143.919570:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265886208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833143.919602:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833143.919645:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265886208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833143.919652:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788833143.919698:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea3955b480 x1875727265886208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833143.919716:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3955b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265886208:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788833144.111394:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788833144.813221:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833145.838304:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833145.988084:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833145.988321:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256413696 00000100:00100000:0.0:1788833145.988334:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256413696 00000100:00100000:0.0:1788833145.988440:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:0.0:1788833145.988454:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+9:10271:x1875727256413696:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833145.988480:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833145.988508:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae7d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988612:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988629:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988645:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988672:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988680:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988687:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988929:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988939:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988945:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988951:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833145.988956:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988976:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.988992:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833145.988995:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833145.989001:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989008:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fec79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989022:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989068:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989075:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989080:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833145.989083:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989089:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989096:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cea08db1500) 00010000:00010000:0.0:1788833145.989099:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833145.989101:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989117:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989156:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae7d expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989168:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833145.989170:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833145.989174:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae7d expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833145.989184:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477200, rc 0) 00000100:00100000:0.0:1788833145.989275:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+9:10271:x1875727256413696:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 824us (1205us total) trans 0 rc 301/301 00000100:00100000:0.0:1788833145.989282:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00080000:3.0:1788833145.989811:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833145.998319:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833145.999513:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256413952 00000100:00100000:3.0:1788833145.999528:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256413952 00000100:00100000:3.0:1788833145.999605:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:3.0:1788833145.999617:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:10271:x1875727256413952:12345-192.168.206.55@tcp:36:lfs.0 00010000:00010000:3.0:1788833145.999703:0:8616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833145.999740:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fec2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae68 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833145.999765:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:3.0:1788833145.999778:0:8616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833146.000106:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.000124:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.000136:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.000165:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.000174:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.000182:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833146.005157:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788833146.005186:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.005198:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.005208:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.005216:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833146.005221:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.005231:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.005255:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:3.0:1788833146.005407:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833146.005416:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.005436:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fec87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833146.005600:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053778c50 reply state 000000007569e8a9 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833146.005611:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833146.007329:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+10:10271:x1875727256413952:12345-192.168.206.55@tcp:36:lfs.0 Request processed in 7703us (9014us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788833146.007344:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00010000:00010000:1.0:1788833146.009024:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.009089:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.009099:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.009106:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833146.009112:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.009122:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.009143:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cea32de4500) 00010000:00010000:1.0:1788833146.009147:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833146.009152:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.009159:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fec8e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833146.156224:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.156380:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256414080 00000100:00100000:0.0:1788833146.156402:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256414080 00000100:00100000:0.0:1788833146.156485:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:0.0:1788833146.156497:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+9:10279:x1875727256414080:12345-192.168.206.55@tcp:101:lctl.0 00010000:00010000:0.0:1788833146.156526:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.156554:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae84 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.156648:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.156674:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.156707:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833146.156765:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833146.156769:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833146.156815:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.156844:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fec95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae84 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.156866:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae84 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.156875:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:0.0:1788833146.156879:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833146.156883:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477400, rc 0) 00000100:00100000:0.0:1788833146.156961:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+10:10279:x1875727256414080:12345-192.168.206.55@tcp:101:lctl.0 Request processed in 465us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833146.156969:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:3.0:1788833146.230867:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833146.231088:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256414208 00000100:00100000:1.0:1788833146.231102:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256414208 00000100:00100000:1.0:1788833146.231172:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:1.0:1788833146.231182:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+10:10285:x1875727256414208:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1788833146.231206:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833146.231229:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3feca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae8b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231317:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231335:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231348:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231362:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231369:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231375:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231480:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fecb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231486:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231493:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833146.231523:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788833146.231527:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833146.231572:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231596:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231603:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231611:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231617:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833146.231622:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231631:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231646:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:1.0:1788833146.231649:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833146.231655:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231672:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3fecaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231689:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231695:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231699:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231720:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932ea00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833146.231724:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231730:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231739:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cea0884e400) 00010000:00010000:1.0:1788833146.231742:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833146.231744:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231750:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3fecb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231785:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3feca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae8b expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231799:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fecb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae8b expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.231806:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:1.0:1788833146.231808:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788833146.231811:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e000, rc 0) 00000100:00100000:1.0:1788833146.231888:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+11:10285:x1875727256414208:12345-192.168.206.55@tcp:101:bash.0 Request processed in 707us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833146.234288:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:3.0:1788833146.234814:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.237225:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256414464 00000100:00100000:0.0:1788833146.237246:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256414464 00000100:00100000:0.0:1788833146.237474:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:0.0:1788833146.237487:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+11:10285:x1875727256414464:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833146.237733:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.237764:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fecbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae92 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.237964:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.237984:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.238001:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.238406:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.238433:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.238446:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788833146.239911:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788833146.240139:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240155:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240166:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240203:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240222:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240228:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240234:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833146.240239:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240246:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240260:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833146.240263:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833146.240267:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240273:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fecc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788833146.240286:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006033f276 reply state 0000000077698c3d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833146.240295:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788833146.240478:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fecbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240494:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.240513:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:0.0:1788833146.240515:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833146.240517:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476400, rc 0) 00000100:00100000:0.0:1788833146.240598:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:10285:x1875727256414464:12345-192.168.206.55@tcp:101:bash.0 Request processed in 3114us (5786us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788833146.240607:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 40 00010000:00010000:1.0:1788833146.246349:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.246380:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.246387:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.246393:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833146.246398:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.246405:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.246422:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea08db1f00) 00010000:00010000:1.0:1788833146.246425:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833146.246429:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.246435:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3feccd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833146.247810:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833146.248090:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256414592 00000100:00100000:3.0:1788833146.248100:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256414592 00000100:00100000:3.0:1788833146.248143:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:3.0:1788833146.248151:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875727256414592:12345-192.168.206.55@tcp:8:bash.0 00010000:00080000:3.0:1788833146.248181:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:3.0:1788833146.248217:0:6656:0:(genops.c:1385:class_connect()) connect: client 458534c2-c478-4b32-bcda-93b4ecf625e9, cookie 0x8c08e876ed3fece2 00002000:00100000:3.0:1788833146.248228:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 458534c2-c478-4b32-bcda-93b4ecf625e9/ffff9cea4096c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788833146.248250:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1788833146.248481:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788833146.248523:0:6656:0:(import.c:65:import_set_state_nolock()) ffff9cea4096f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833146.248589:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2356:x1875727256414592:12345-192.168.206.55@tcp:8:bash.0 Request processed in 438us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833146.248598:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:3.0:1788833146.252127:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.252196:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256414720 00000100:00100000:0.0:1788833146.252211:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256414720 00000100:00100000:0.0:1788833146.252292:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:0.0:1788833146.252304:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:0:x1875727256414720:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833146.252329:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.252353:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72ae99 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788833146.252379:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833146.252397:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1788833146.252402:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833146.252411:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 7 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.252430:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 7 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.252443:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477200, rc 0) 00000100:00100000:0.0:1788833146.252508:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:0:x1875727256414720:12345-192.168.206.55@tcp:101:bash.0 Request processed in 207us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833146.252527:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00080000:3.0:1788833146.252927:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788833146.262323:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833146.262522:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256414848 00000100:00100000:3.0:1788833146.262531:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256414848 00000100:00100000:3.0:1788833146.262603:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1788833146.262612:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:10285:x1875727256414848:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833146.262628:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833146.262650:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aea0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.262688:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 8 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.262697:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833146.262702:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833146.262706:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.262738:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 8 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.262751:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 8 pid: 6654 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833146.262765:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03929180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6656:1875727265886336:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833146.262850:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788833146.269097:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03929180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6656:1875727265886336:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833146.269146:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.269202:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:3.0:1788833146.269288:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:10285:x1875727256414848:12345-192.168.206.55@tcp:101:bash.0 Request processed in 6676us (6975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833146.269298:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1788833146.271216:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.271376:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256414976 00000100:00100000:0.0:1788833146.271388:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256414976 00010000:00010000:0.0:1788833146.271441:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 8 pid: 6654 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833146.271496:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:0.0:1788833146.271519:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256414976:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833146.271539:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833146.271568:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 8 pid: 6654 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.271585:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 8 pid: 6654 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.271631:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058914bdb/0x8c08e876ed3fece9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae99 expref: 8 pid: 6654 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.271651:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833146.271656:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833146.271676:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.271688:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.271769:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833146.271796:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265886464:192.168.206.55@tcp:105: 00000100:00100000:0.0:1788833146.271900:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324780 going to sleep for 11 seconds 00000100:00100000:1.0:1788833146.276619:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.276751:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265886464:192.168.206.55@tcp:105: 00010000:00010000:0.0:1788833146.276775:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833146.276833:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256414976:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 5327us (5629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833146.276844:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:3.0:1788833146.277575:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256415232 00000100:00100000:3.0:1788833146.277583:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256415232 00000100:00100000:3.0:1788833146.277632:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:3.0:1788833146.277641:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+13:10285:x1875727256415232:12345-192.168.206.55@tcp:35:bash.0 00000001:00080000:3.0:1788833146.278580:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:3.0:1788833146.279756:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+15:10285:x1875727256415232:12345-192.168.206.55@tcp:35:bash.0 Request processed in 2109us (3140us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788833146.279767:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000020:00080000:3.0:1788833146.279772:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788833146.401726:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.401883:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256415488 00000100:00100000:2.0:1788833146.401893:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256415488 00000100:00100000:2.0:1788833146.402107:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:2.0:1788833146.402132:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+15:10295:x1875727256415488:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833146.402154:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833146.402173:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3fecf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aea7 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833146.402261:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788833146.402388:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3fecf7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea7 expref: 17 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.402403:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:2.0:1788833146.402406:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833146.402411:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3fecf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea7 expref: 17 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.402426:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037200, rc 0) 00000100:00100000:2.0:1788833146.402495:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+16:10295:x1875727256415488:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 365us (778us total) trans 4294967314 rc 301/301 00000100:00100000:2.0:1788833146.402502:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:1.0:1788833146.408814:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.408985:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256415744 00000100:00100000:0.0:1788833146.408994:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256415744 00000100:00100000:0.0:1788833146.409079:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:0.0:1788833146.409090:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+16:10295:x1875727256415744:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833146.409534:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+17:10295:x1875727256415744:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 444us (727us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788833146.409542:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1788833146.495164:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.495354:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256415872 00000100:00100000:2.0:1788833146.495367:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256415872 00000100:00100000:2.0:1788833146.495454:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:2.0:1788833146.495465:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+17:10300:x1875727256415872:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833146.495497:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833146.495811:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3fed05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aeae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.495904:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3fed0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.495940:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3fed0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.495955:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3fed0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833146.496002:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788833146.496006:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833146.496063:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3fed0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.496097:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3fed05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeae expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.496119:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3fed0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeae expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.496129:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833146.496132:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833146.496136:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037c00, rc 0) 00000100:00100000:2.0:1788833146.496217:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+18:10300:x1875727256415872:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 753us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833146.496225:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:1.0:1788833146.498932:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.499088:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256416128 00000100:00100000:0.0:1788833146.499102:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256416128 00000100:00100000:0.0:1788833146.499168:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:0.0:1788833146.499180:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+18:10300:x1875727256416128:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833146.499207:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.499233:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fed13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aeb5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.499406:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fed1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.499425:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fed1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.499439:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fed1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833146.499451:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788833146.499628:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477200/0x8c08e876ed3fed13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeb5 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.499650:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fed1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeb5 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.499671:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:0.0:1788833146.499674:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833146.499677:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32477c00, rc 0) 00000100:00100000:0.0:1788833146.499980:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+20:10300:x1875727256416128:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 801us (1062us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788833146.499989:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:1.0:1788833146.503144:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833146.503186:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.503323:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256416512 00000100:00100000:2.0:1788833146.503334:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256416512 00000100:00100000:2.0:1788833146.503424:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:2.0:1788833146.503437:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+20:2359:x1875727256416512:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833146.503456:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833146.503494:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477c00/0x8c08e876ed3fed1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeb5 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.503528:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:2.0:1788833146.503533:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833146.503596:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+19:2359:x1875727256416512:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 162us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833146.503614:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:0.0:1788833146.504082:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256416384 00000100:00100000:0.0:1788833146.504089:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256416384 00000100:00100000:0.0:1788833146.504131:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:0.0:1788833146.504139:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10300:x1875727256416384:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833146.504163:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.504192:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476e00/0x8c08e876ed3fed28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aebc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.504314:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3fed2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.504331:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3fed2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.504343:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3fed2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833146.504356:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788833146.504530:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476e00/0x8c08e876ed3fed28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aebc expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.504550:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3fed2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aebc expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.504559:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:0.0:1788833146.504562:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788833146.504565:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea32476a00, rc 0) 00000100:00100000:0.0:1788833146.504611:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10300:x1875727256416384:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 472us (1481us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788833146.504619:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:3.0:1788833146.512166:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.512615:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256416640 00000100:00100000:0.0:1788833146.512628:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256416640 00000100:00100000:0.0:1788833146.512707:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:0.0:1788833146.512718:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256416640:12345-192.168.206.55@tcp:1:lfs.0 00010000:00010000:0.0:1788833146.512809:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.512835:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.512845:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833146.512850:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833146.512856:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.512902:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.512919:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 7 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833146.512936:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1875727265886592:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833146.513079:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03324480 going to sleep for 11 seconds 00000100:00100000:0.0:1788833146.515981:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1875727265886592:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833146.516021:0:6654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833146.516774:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.516931:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256416768 00000100:00100000:2.0:1788833146.516942:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256416768 00002000:00100000:2.0:1788833146.517007:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9cea0392ad80 x1875727256416768/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:332/0 lens 504/0 e 0 to 0 dl 1788833157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788833146.517019:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea0392ad80 with x1875727256416768 ext(0->12) 00010000:00010000:2.0:1788833146.517077:0:6659:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 8 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.517095:0:6659:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 8 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788833146.517102:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cea0392ad80 00000100:00100000:2.0:1788833146.517132:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:2.0:1788833146.517143:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256416768:12345-192.168.206.55@tcp:4:lfs.0 00000001:00100000:3.0:1788833146.552265:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000100:00100000:3.0:1788833146.553394:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256416768:12345-192.168.206.55@tcp:4:lfs.0 Request processed in 36244us (36614us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788833146.553416:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00002000:00100000:3.0:1788833146.553432:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9cea0392ad80 x1875727256416768/t4294967299(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:332/0 lens 504/448 e 0 to 0 dl 1788833157 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833146.553443:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea0392ad80 with x1875727256416768 ext(0->12) 00010000:00010000:3.0:1788833146.553472:0:6659:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 9 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833146.553497:0:6659:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 9 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833146.553518:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cea0392ad80 00000100:00100000:1.0:1788833146.556392:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.556574:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256416896 00000100:00100000:2.0:1788833146.556588:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256416896 00010000:00010000:2.0:1788833146.556781:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 9 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833146.556907:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:2.0:1788833146.556920:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256416896:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833146.556941:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788833146.556967:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788833146.556971:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788833146 00002000:00010000:2.0:1788833146.556973:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788833146 00002000:00010000:2.0:1788833146.556976:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788833146 00010000:00010000:2.0:1788833146.556983:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 9 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.556999:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 9 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.557069:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed3fecf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aea0 expref: 9 pid: 6656 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.557093:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833146.557099:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833146.557105:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.557117:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.557150:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833146.557225:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256416896:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 307us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833146.557234:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 36 00010000:00010000:1.0:1788833146.557467:0:6654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557478:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557514:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557524:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557533:0:6654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557541:0:6654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833146.557546:0:6654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557556:0:6654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557572:0:6654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.557581:0:6654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8ccfee/0x8c08e876ed3fed3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833146.557680:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256416640:12345-192.168.206.55@tcp:1:lfs.0 Request processed in 44963us (45528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833146.557690:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:1.0:1788833146.559862:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833146.559961:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256417152 00000100:00100000:3.0:1788833146.559972:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256417152 00000100:00100000:0.0:1788833146.560281:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:0.0:1788833146.560298:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10300:x1875727256417152:12345-192.168.206.55@tcp:35:lfs.0 00000004:00010000:0.0:1788833146.560399:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3fed2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aebc expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833146.560790:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788833146.560840:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788833146.561567:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:0.0:1788833146.561645:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.561677:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.561688:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.561740:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.561761:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 25 pid: 5812 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833146.561778:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265886720:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833146.561898:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07d3be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833146.564234:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265886720:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833146.564273:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833146.564596:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.564696:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256417280 00000100:00100000:2.0:1788833146.564706:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256417280 00010000:00010000:2.0:1788833146.564764:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 26 pid: 5812 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833146.564890:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:2.0:1788833146.564903:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+26:2358:x1875727256417280:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833146.564922:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833146.564931:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 26 pid: 5812 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.564946:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 26 pid: 5812 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.564973:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476400/0x8c08e876ed3fecd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae92 expref: 26 pid: 5812 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.564991:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:2.0:1788833146.564997:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.565008:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.565017:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.565134:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833146.565203:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+25:2358:x1875727256417280:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 301us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833146.565211:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00010000:00010000:1.0:1788833146.565510:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.565519:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788833146.565699:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:1.0:1788833146.565979:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788833146.566298:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265886848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788833146.571142:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833146.571266:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea101d5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833146.571381:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265886848 00000100:00100000:2.0:1788833146.571391:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265886848 00000100:00100000:2.0:1788833146.571455:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833146.571466:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265886848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788833146.571497:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833146.571626:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265886848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 161us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833146.571635:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833146.571873:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265886848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788833146.572975:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788833146.573181:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265886976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788833146.573505:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833146.573538:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea101d5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833146.573651:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265886976 00000100:00100000:0.0:1788833146.573691:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265886976 00000100:00100000:0.0:1788833146.573779:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833146.573791:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265886976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788833146.574159:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1875727265886976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 369us (653us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788833146.574168:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833146.574411:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265886976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788833146.574487:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788833146.574542:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.574565:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.574572:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.574577:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833146.574582:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.574589:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.574603:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:1.0:1788833146.574606:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788833146.574611:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833146.575374:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3fed44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788833146.575587:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788833146.576546:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788833146.576562:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280642530158ns, next at 281642527642ns, rc = 0 00000001:00080000:1.0:1788833146.576573:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788833146.576766:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1700) 00010000:00010000:1.0:1788833146.576771:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788833146.576779:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32476a00/0x8c08e876ed3fed2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aebc expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833146.577561:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+28:10300:x1875727256417152:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 17266us (17707us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788833146.577577:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000020:00080000:1.0:1788833146.577583:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788833146.581156:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.581372:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256417408 00000100:00100000:0.0:1788833146.581393:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256417408 00000100:00100000:0.0:1788833146.581463:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:0.0:1788833146.581474:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+28:10300:x1875727256417408:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833146.581510:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.581540:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fed4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aec3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.581630:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fed4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aec3 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.581648:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fed4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aec3 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.581680:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833146.581684:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833146.581689:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ae00, rc 0) 00000100:00100000:0.0:1788833146.581765:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10300:x1875727256417408:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 292us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833146.581774:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:3.0:1788833146.585569:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.585914:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256417664 00000100:00100000:0.0:1788833146.586022:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256417664 00000100:00100000:0.0:1788833146.586119:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:0.0:1788833146.586129:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af0b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10300:x1875727256417664:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833146.586445:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af0b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10300:x1875727256417664:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 316us (891us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788833146.586454:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1788833146.677853:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.678113:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256417920 00000100:00100000:0.0:1788833146.678128:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256417920 00000100:00100000:0.0:1788833146.678216:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:0.0:1788833146.678229:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10311:x1875727256417920:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833146.678263:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.678292:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fed52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aeca expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833146.678411:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788833146.678577:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fed52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeca expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.678595:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:0.0:1788833146.678612:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833146.678618:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fed52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeca expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.678636:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b600, rc 0) 00000100:00100000:0.0:1788833146.678728:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10311:x1875727256417920:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 501us (890us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1788833146.678737:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:3.0:1788833146.683186:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.683537:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256418048 00000100:00100000:0.0:1788833146.683549:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256418048 00000100:00100000:0.0:1788833146.683623:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:0.0:1788833146.683635:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10311:x1875727256418048:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:0.0:1788833146.683760:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683782:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683796:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683814:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683822:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683829:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683951:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683959:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.683966:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788833146.684021:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684078:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684086:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684093:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684100:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925aa00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833146.684105:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684113:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684128:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833146.684131:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833146.684136:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684142:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3fed60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684155:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684161:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684166:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684177:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833146.684181:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684187:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684194:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea08db1600) 00010000:00010000:0.0:1788833146.684196:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833146.684199:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684204:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fed67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684219:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684225:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684231:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684235:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833146.684238:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684244:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684262:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833146.684265:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833146.684268:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.684273:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833146.684370:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10311:x1875727256418048:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 736us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833146.684389:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:3.0:1788833146.688676:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.688997:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256418304 00000100:00100000:0.0:1788833146.689010:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256418304 00000100:00100000:0.0:1788833146.689143:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:0.0:1788833146.689155:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10311:x1875727256418304:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833146.689464:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10311:x1875727256418304:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 311us (813us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788833146.689474:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:1.0:1788833146.733808:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.734115:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256418560 00000100:00100000:2.0:1788833146.734128:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256418560 00000100:00100000:2.0:1788833146.734203:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:2.0:1788833146.734215:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10314:x1875727256418560:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833146.734245:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833146.734272:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3fed75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aed1 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734370:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734512:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734525:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734562:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734569:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734575:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734741:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734749:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734756:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833146.734766:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788833146.734893:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734902:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734909:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734916:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833146.734932:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734955:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734969:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833146.734972:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833146.734978:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.734985:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3fed7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735001:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735006:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735012:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735018:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833146.735021:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735027:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735509:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea1539c500) 00010000:00010000:2.0:1788833146.735512:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833146.735517:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735534:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3fed83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735595:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3fed75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735685:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 34 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833146.735693:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833146.735696:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833146.735699:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036000, rc 0) 00000100:00100000:2.0:1788833146.735836:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10314:x1875727256418560:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 1623us (2042us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788833146.735846:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:3.0:1788833146.740885:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833146.741830:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256418688 00000100:00100000:2.0:1788833146.741846:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256418688 00000100:00100000:0.0:1788833146.742063:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:0.0:1788833146.742079:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10314:x1875727256418688:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:0.0:1788833146.742168:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742189:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742202:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742250:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742257:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742264:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742271:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833146.742275:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742282:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742296:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833146.742300:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833146.742306:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.742312:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833146.742420:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10314:x1875727256418688:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 345us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833146.742429:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:3.0:1788833146.745166:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833146.745684:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256418944 00000100:00100000:1.0:1788833146.745699:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256418944 00000100:00100000:1.0:1788833146.745768:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:1.0:1788833146.745780:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10314:x1875727256418944:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:1.0:1788833146.746125:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10314:x1875727256418944:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 345us (968us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788833146.746134:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00010000:00010000:2.0:1788833146.862305:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833146.988177:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833146.988598:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256419200 00000100:00100000:0.0:1788833146.988620:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256419200 00000100:00100000:0.0:1788833146.988704:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:0.0:1788833146.988745:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10345:x1875727256419200:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:0.0:1788833146.988780:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833146.988808:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aed8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.988972:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3feda6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.988990:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3feda6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.989007:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3feda6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833146.989021:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788833146.989283:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fed9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed8 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.989305:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3feda6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed8 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833146.989314:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833146.989318:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833146.989322:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b800, rc 0) 00000100:00100000:2.0:1788833146.996471:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+37:10345:x1875727256419200:12345-192.168.206.55@tcp:101:cat.0 Request processed in 7622us (8200us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788833146.996489:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:3.0:1788833147.002064:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833147.002118:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.002263:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256419456 00000100:00100000:0.0:1788833147.002276:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256419456 00000100:00100000:0.0:1788833147.002356:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:0.0:1788833147.002368:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+37:10345:x1875727256419456:12345-192.168.206.55@tcp:35:cat.0 00000100:00100000:0.0:1788833147.002861:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+38:10345:x1875727256419456:12345-192.168.206.55@tcp:35:cat.0 Request processed in 492us (839us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788833147.002888:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:2.0:1788833147.003419:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256419584 00000100:00100000:2.0:1788833147.003429:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256419584 00000100:00100000:2.0:1788833147.003479:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:2.0:1788833147.003488:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+38:2357:x1875727256419584:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833147.003501:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833147.003540:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3feda6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed8 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.003560:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833147.003565:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833147.003601:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+37:2357:x1875727256419584:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 114us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833147.003608:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00080000:3.0:1788833147.003966:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833147.076573:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.079070:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256419840 00000100:00100000:0.0:1788833147.079090:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256419840 00000100:00100000:0.0:1788833147.079162:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:0.0:1788833147.079175:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+37:10351:x1875727256419840:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:0.0:1788833147.079203:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833147.079208:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788833147.079240:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3fed0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeae expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.079262:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833147.079268:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833147.079284:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fedb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aedf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.079419:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.079435:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.079444:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.079485:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.079500:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 37 pid: 5813 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.079530:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265887104:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833147.079651:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07d3b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833147.087554:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.088265:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265887104:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833147.088301:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833147.091409:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256419968 00000100:00100000:3.0:1788833147.091435:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256419968 00010000:00010000:3.0:1788833147.091507:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 38 pid: 5813 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833147.091564:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:3.0:1788833147.091575:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+38:2358:x1875727256419968:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833147.091593:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833147.091601:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 38 pid: 5813 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.091638:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 38 pid: 5813 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.091693:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3fed8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aed1 expref: 38 pid: 5813 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.091722:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:3.0:1788833147.091729:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.091740:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.091749:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.091798:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833147.091875:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+37:2358:x1875727256419968:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 301us (4335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833147.091883:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00010000:00010000:1.0:1788833147.092175:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.092185:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833147.092209:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788833147.092427:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fedb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.092463:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 37 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.092473:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:1.0:1788833147.092476:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833147.092479:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b600, rc 0) 00000100:00100000:1.0:1788833147.092520:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+37:10351:x1875727256419840:12345-192.168.206.55@tcp:101:dd.0 Request processed in 13348us (15957us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788833147.092529:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:2.0:1788833147.099435:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833147.100706:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256420224 00000100:00100000:1.0:1788833147.100731:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256420224 00000100:00100000:0.0:1788833147.101057:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:0.0:1788833147.101071:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3955b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+37:10351:x1875727256420224:12345-192.168.206.55@tcp:36:dd.0 00010000:00010000:0.0:1788833147.101449:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.101471:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.101486:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833147.101551:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:0.0:1788833147.101579:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022a1e766 reply state 00000000ffe67acf transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.101592:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833147.101732:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3955b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+40:10351:x1875727256420224:12345-192.168.206.55@tcp:36:dd.0 Request processed in 662us (2311us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788833147.101741:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 52 00000020:00080000:0.0:1788833147.101746:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788833147.108856:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.108881:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.108890:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.108897:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925be00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833147.108903:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.108913:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.108935:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:1.0:1788833147.108939:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833147.108967:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.108975:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fedc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833147.114509:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00000004:00080000:2.0:1788833147.114564:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788833147.114590:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cea101d5840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788833147.114596:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f4ae000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cea101d59c0 00000020:00080000:2.0:1788833147.114600:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f4aeb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea3f5b6800 00000020:00080000:3.0:1788833147.114642:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788833147.114815:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788833147.115109:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788833147.115153:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265887232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788833147.115240:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833147.115298:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265887232 00000100:00100000:0.0:1788833147.115308:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265887232 00000100:00100000:0.0:1788833147.115367:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788833147.115377:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1875727265887232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788833147.115411:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788833147.115524:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f6d7a, atime: 0x6a9f6d7a, ctime: 0x6a9f6d7a, blocks: 0x1 00010000:00010000:0.0:1788833147.115534:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.115555:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=281s v=(0 0) 00010000:00010000:0.0:1788833147.115561:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833147.115568:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.115588:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.115600:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.115609:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.115630:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788833147.116739:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265887232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1357us (1492us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788833147.116760:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788833147.116806:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833147.116815:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.116828:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ba00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833147.116834:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.116845:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.116872:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.116879:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047cfe1c3/0x8c08e876ed3fedd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788833147.116886:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea3fc46d80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788833147.116893:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265887232:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788833147.116900:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833147.116902:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833147.116903:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833147.474253:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833147.474345:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256420352 00000100:00100000:3.0:1788833147.474356:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256420352 00000100:00100000:3.0:1788833147.474431:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:3.0:1788833147.474441:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+15:10365:x1875727256420352:12345-192.168.206.55@tcp:101:stat.0 00010000:00010000:3.0:1788833147.474475:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833147.474494:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fedd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aee6 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.474570:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.474707:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.474720:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.474736:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.474743:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.474750:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.475086:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.475098:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.475107:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.475139:0:8616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.475160:0:8616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 16 pid: 5811 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833147.475174:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0392bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265887360:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833147.475268:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833147.480428:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0392bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265887360:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833147.480470:0:8616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833147.483081:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.484611:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256420608 00000100:00100000:0.0:1788833147.484635:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256420608 00000100:00100000:0.0:1788833147.484759:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:0.0:1788833147.484772:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+17:6056:x1875727256420608:12345-192.168.206.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788833147.485294:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+18:6056:x1875727256420608:12345-192.168.206.55@tcp:35:ldlm_bl.0 Request processed in 521us (2217us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788833147.485324:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:3.0:1788833147.488160:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833147.494805:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256420736 00000100:00100000:2.0:1788833147.494820:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256420736 00010000:00010000:2.0:1788833147.494870:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 18 pid: 5811 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833147.494924:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:2.0:1788833147.494946:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:2357:x1875727256420736:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833147.494961:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833147.494968:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 18 pid: 5811 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.494981:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 18 pid: 5811 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.495004:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fedbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aedf expref: 18 pid: 5811 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.495020:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833147.495026:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.495067:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.495074:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.495712:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833147.495782:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+17:2357:x1875727256420736:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 835us (7629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833147.495790:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 39 00010000:00010000:3.0:1788833147.500178:0:8616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.500195:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833147.500247:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788833147.500251:0:8616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833147.500299:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.500314:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.500324:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.500331:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.500338:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.500345:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833147.500360:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.500379:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.501985:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:3.0:1788833147.501989:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833147.501995:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502003:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fedde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502024:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502540:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502548:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502554:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833147.502558:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502566:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502586:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea32de4500) 00010000:00010000:3.0:1788833147.502590:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833147.502696:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502702:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fede5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502754:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fedd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aee6 expref: 17 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502769:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aee6 expref: 16 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.502778:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:3.0:1788833147.502780:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833147.502783:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:3.0:1788833147.502907:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+16:10365:x1875727256420352:12345-192.168.206.55@tcp:101:stat.0 Request processed in 28466us (28661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833147.502915:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:3.0:1788833147.593283:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.595013:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256420992 00000100:00100000:0.0:1788833147.595026:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256420992 00000100:00100000:0.0:1788833147.595128:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:0.0:1788833147.595139:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+16:10371:x1875727256420992:12345-192.168.206.55@tcp:36:truncate.0 00010000:00010000:0.0:1788833147.595193:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833147.595221:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fedec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aee6 expref: 16 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.595241:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833147.595245:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833147.595475:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.595489:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.595501:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833147.595552:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:0.0:1788833147.595649:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000531016d1 reply state 00000000b7e57c49 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.595668:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833147.595784:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+18:10371:x1875727256420992:12345-192.168.206.55@tcp:36:truncate.0 Request processed in 646us (2509us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788833147.595791:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 54 00000020:00080000:0.0:1788833147.595802:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788833147.605517:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833147.605565:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833147.605616:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.605634:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256421120 00000100:00100000:0.0:1788833147.605645:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256421120 00000100:00100000:1.0:1788833147.605724:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256421248 00000100:00100000:1.0:1788833147.605728:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256421248 00000100:00100000:1.0:1788833147.605775:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:1.0:1788833147.605785:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256421248:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833147.605852:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256421248:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 69us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833147.605860:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:0.0:1788833147.606050:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 282 00000100:00100000:0.0:1788833147.606059:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256421120:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833147.606092:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256421120:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 35us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833147.606099:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 282 00000100:00100000:3.0:1788833147.609027:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256421376 00000100:00100000:3.0:1788833147.609057:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256421376 00000100:00100000:3.0:1788833147.609137:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 124 00000100:00100000:3.0:1788833147.609146:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256421376:12345-192.168.206.55@tcp:400:kworker.0 00000100:00080000:0.0:1788833147.609562:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833147.620780:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256421376:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 11624us (15152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833147.620794:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 124 00010000:00010000:3.0:1788833147.627591:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.627727:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.627735:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.627741:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833147.627745:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.627753:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.627769:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:3.0:1788833147.627772:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833147.627777:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833147.627784:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fedf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833147.753261:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.753551:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256421504 00000100:00100000:0.0:1788833147.753560:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256421504 00000100:00100000:0.0:1788833147.753619:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:0.0:1788833147.753630:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+17:10385:x1875727256421504:12345-192.168.206.55@tcp:101:stat.0 00010000:00010000:0.0:1788833147.753652:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833147.753686:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fedfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aeed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.753748:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.753762:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.753773:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.753787:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.753794:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.753809:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754311:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754322:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754330:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833147.754362:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788833147.754367:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833147.754400:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754411:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754496:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754505:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754513:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754519:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ac00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833147.754524:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754536:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754548:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833147.754551:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833147.754555:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754561:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3fee01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754572:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754578:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754583:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754587:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833147.754590:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754596:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754603:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea08db1200) 00010000:00010000:0.0:1788833147.754605:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833147.754608:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754623:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754671:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fedfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754685:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.754692:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833147.754695:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833147.754698:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925bc00, rc 0) 00000100:00100000:0.0:1788833147.754806:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:10385:x1875727256421504:12345-192.168.206.55@tcp:101:stat.0 Request processed in 1177us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833147.754813:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:1.0:1788833147.863600:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833147.863922:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256421760 00000100:00100000:2.0:1788833147.863932:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256421760 00000100:00100000:2.0:1788833147.863988:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 56 00000100:00100000:2.0:1788833147.863998:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+18:10395:x1875727256421760:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833147.864016:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833147.864060:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aef4 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833147.864143:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788833147.864252:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aef4 expref: 20 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.864266:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:2.0:1788833147.864269:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833147.864274:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aef4 expref: 20 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.864295:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037600, rc 0) 00000100:00100000:2.0:1788833147.864353:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10395:x1875727256421760:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 357us (763us total) trans 4294967340 rc 301/301 00000100:00100000:2.0:1788833147.864359:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 56 00000100:00100000:2.0:1788833147.867897:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.868007:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256422016 00000100:00100000:0.0:1788833147.868016:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256422016 00000100:00100000:0.0:1788833147.868100:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:0.0:1788833147.868110:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10395:x1875727256422016:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833147.868328:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+20:10395:x1875727256422016:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 219us (440us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788833147.868336:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00010000:00010000:0.0:1788833147.885782:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833147.942071:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833147.943740:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256422272 00000100:00100000:2.0:1788833147.943754:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256422272 00000100:00100000:2.0:1788833147.943864:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:2.0:1788833147.943876:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+20:10401:x1875727256422272:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1788833147.943898:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833147.943931:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aefb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.944044:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.944060:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.944069:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.944100:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.944114:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 21 pid: 5812 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833147.944127:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0674ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265887488:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833147.944217:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833147.948465:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833147.948535:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0674ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265887488:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833147.948565:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.949729:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256422400 00000100:00100000:0.0:1788833147.949740:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256422400 00010000:00010000:0.0:1788833147.949797:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 22 pid: 5812 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.949844:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:0.0:1788833147.949853:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+22:2357:x1875727256422400:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833147.949867:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833147.949874:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 22 pid: 5812 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.949887:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 22 pid: 5812 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.949910:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aeed expref: 22 pid: 5812 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.949927:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833147.949933:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.949943:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.949950:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.949979:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833147.950020:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.950083:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+21:2357:x1875727256422400:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 230us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833147.950091:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 40 00010000:00010000:2.0:1788833147.950259:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833147.950369:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788833147.951213:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.951234:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.951242:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833147.951245:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788833147.951248:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036e00, rc 0) 00000100:00100000:2.0:1788833147.951759:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10401:x1875727256422272:12345-192.168.206.55@tcp:101:bash.0 Request processed in 7883us (9723us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788833147.951767:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:3.0:1788833147.955185:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833147.955253:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256422656 00000100:00100000:2.0:1788833147.955267:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256422656 00000100:00100000:2.0:1788833147.955347:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00100000:2.0:1788833147.955358:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10401:x1875727256422656:12345-192.168.206.55@tcp:36:bash.0 00010000:00010000:2.0:1788833147.955601:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.955617:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833147.955627:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833147.955702:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:2.0:1788833147.955745:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f51aee87 reply state 00000000cd8fc665 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833147.955754:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833147.955846:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+24:10401:x1875727256422656:12345-192.168.206.55@tcp:36:bash.0 Request processed in 489us (674us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788833147.955853:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 58 00000020:00080000:2.0:1788833147.955857:0:8616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788833147.957359:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.957374:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.957381:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.957387:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833147.957391:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.957399:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.957414:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:1.0:1788833147.957428:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833147.957434:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.957440:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3fee39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833147.962819:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.963477:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256422784 00000100:00100000:0.0:1788833147.963488:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256422784 00000100:00100000:0.0:1788833147.963553:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:0.0:1788833147.963565:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+23:10401:x1875727256422784:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833147.963589:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833147.963609:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af02 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.963699:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.963714:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.963723:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.963754:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.963766:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 24 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.963778:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265887616:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833147.963859:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07d3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833147.969539:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265887616:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833147.969569:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833147.969991:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.970684:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256422912 00000100:00100000:0.0:1788833147.970693:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256422912 00010000:00010000:0.0:1788833147.970733:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 25 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833147.970829:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:0.0:1788833147.970840:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+25:2357:x1875727256422912:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833147.970854:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833147.970860:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 25 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.970871:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 25 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.970891:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fee2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aefb expref: 25 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.970906:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:0.0:1788833147.970910:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.970919:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.970926:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833147.970960:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833147.971026:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+24:2357:x1875727256422912:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 187us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833147.971078:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 41 00010000:00010000:1.0:1788833147.971142:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.971151:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833147.971192:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788833147.971197:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833147.971216:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.971245:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3fee40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af02 expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.971259:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af02 expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833147.971266:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:1.0:1788833147.971269:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833147.971272:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a200, rc 0) 00000100:00100000:1.0:1788833147.971306:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+23:10401:x1875727256422784:12345-192.168.206.55@tcp:101:bash.0 Request processed in 7744us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833147.971314:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:3.0:1788833147.975957:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833147.976178:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256423168 00000100:00100000:0.0:1788833147.976188:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256423168 00000100:00100000:0.0:1788833147.976246:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:0.0:1788833147.976256:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+23:10401:x1875727256423168:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:0.0:1788833147.976472:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+24:10401:x1875727256423168:12345-192.168.206.55@tcp:35:bash.0 Request processed in 217us (522us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788833147.976480:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:3.0:1788833148.095967:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833148.096743:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256423424 00000100:00100000:2.0:1788833148.096759:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256423424 00000100:00100000:2.0:1788833148.096843:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:2.0:1788833148.096856:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+24:10411:x1875727256423424:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833148.096887:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833148.096915:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af09 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833148.097075:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788833148.097367:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af09 expref: 26 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.097385:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:2.0:1788833148.097389:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833148.097395:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af09 expref: 26 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.097423:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037600, rc 0) 00000100:00100000:2.0:1788833148.097702:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+25:10411:x1875727256423424:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 847us (1751us total) trans 4294967346 rc 301/301 00000100:00100000:2.0:1788833148.097712:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:3.0:1788833148.105007:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833148.105267:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256423552 00000100:00100000:2.0:1788833148.105281:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256423552 00000100:00100000:2.0:1788833148.105357:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:2.0:1788833148.105370:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+25:10411:x1875727256423552:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:2.0:1788833148.105702:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.105726:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.105741:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.105761:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.105768:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.105776:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106193:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106205:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106213:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833148.106268:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106295:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106302:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106310:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106316:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833148.106322:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106330:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106345:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833148.106349:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833148.106354:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106361:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fee5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106375:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106381:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106387:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.106399:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833148.106402:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.107974:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108002:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea1539c500) 00010000:00010000:2.0:1788833148.108005:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833148.108011:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108019:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3fee63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108066:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108075:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108082:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108099:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833148.108103:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108109:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108142:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833148.108145:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833148.108148:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.108154:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833148.108283:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+25:10411:x1875727256423552:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 2909us (3285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.108294:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:1.0:1788833148.113804:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833148.113931:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256423808 00000100:00100000:0.0:1788833148.113944:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256423808 00000100:00100000:0.0:1788833148.114018:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:0.0:1788833148.114079:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+25:10411:x1875727256423808:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833148.114396:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+26:10411:x1875727256423808:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 368us (606us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788833148.114590:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:3.0:1788833148.224975:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833148.225250:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256424064 00000100:00100000:2.0:1788833148.225263:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256424064 00000100:00100000:3.0:1788833148.225470:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:3.0:1788833148.225516:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+26:10414:x1875727256424064:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833148.225557:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833148.225585:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fee71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af10 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.230809:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.230840:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.230856:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.230877:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.230886:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.230892:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.231451:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fee86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.231465:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fee86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.231474:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fee86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833148.231858:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788833148.231988:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.231998:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232005:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232012:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833148.232017:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232025:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232065:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:3.0:1788833148.232069:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833148.232074:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232080:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3fee78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232102:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232107:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232126:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232131:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833148.232134:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232140:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232148:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea32de4500) 00010000:00010000:3.0:1788833148.232150:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833148.232153:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232159:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3fee7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232225:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3fee71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af10 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232243:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fee86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af10 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833148.232251:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:3.0:1788833148.232253:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833148.232256:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:3.0:1788833148.234768:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+28:10414:x1875727256424064:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 9252us (9789us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788833148.234812:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:3.0:1788833148.239575:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833148.239670:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833148.239896:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256424320 00000100:00100000:2.0:1788833148.239909:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256424320 00000100:00100000:2.0:1788833148.239998:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:2.0:1788833148.240011:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+28:2357:x1875727256424320:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833148.240063:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833148.240099:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fee86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af10 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.240124:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833148.240131:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833148.240198:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+27:2357:x1875727256424320:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 189us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.240206:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:1.0:1788833148.241082:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256424192 00000100:00100000:1.0:1788833148.241103:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256424192 00000100:00100000:1.0:1788833148.241161:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:1.0:1788833148.241171:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+27:10414:x1875727256424192:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:1.0:1788833148.241253:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241273:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241286:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241318:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241325:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241333:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241340:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fa00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833148.241345:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241353:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241364:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:1.0:1788833148.241367:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788833148.241388:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.241396:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3fee94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833148.241475:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+27:10414:x1875727256424192:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 304us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833148.241483:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:3.0:1788833148.243873:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833148.244239:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256424576 00000100:00100000:1.0:1788833148.244253:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256424576 00000100:00100000:1.0:1788833148.244322:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:1.0:1788833148.244334:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+27:10414:x1875727256424576:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:1.0:1788833148.244667:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+28:10414:x1875727256424576:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 334us (809us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788833148.244676:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1788833148.450214:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833148.453461:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256424832 00000100:00100000:2.0:1788833148.453506:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256424832 00000100:00100000:2.0:1788833148.453617:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:2.0:1788833148.453630:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+28:10431:x1875727256424832:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:2.0:1788833148.453672:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833148.453703:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af17 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.453864:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3feea2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.453883:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3feea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.453898:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3feea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833148.453911:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788833148.454125:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3fee9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af17 expref: 31 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.454148:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3feea2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af17 expref: 30 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.454159:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833148.454162:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788833148.454166:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036800, rc 0) 00000100:00100000:2.0:1788833148.454267:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10431:x1875727256424832:12345-192.168.206.55@tcp:101:cat.0 Request processed in 639us (4068us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788833148.454481:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:0.0:1788833148.492781:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833148.493205:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256424960 00000100:00100000:1.0:1788833148.493218:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256424960 00000100:00100000:1.0:1788833148.493296:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:1.0:1788833148.493308:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10433:x1875727256424960:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833148.493338:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833148.493364:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3feeb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af1e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.493448:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feeb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.493465:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.493575:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833148.493696:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788833148.493701:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833148.493947:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.493981:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3feeb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af1e expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.494006:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feeb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af1e expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833148.494984:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:1.0:1788833148.494990:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833148.494995:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f800, rc 0) 00000100:00100000:1.0:1788833148.495139:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10433:x1875727256424960:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 1827us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833148.495151:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:3.0:1788833148.499274:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833148.501007:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256425344 00000100:00100000:0.0:1788833148.501022:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256425344 00000100:00100000:0.0:1788833148.501167:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:0.0:1788833148.501179:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10433:x1875727256425344:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833148.501515:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10433:x1875727256425344:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 338us (2255us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788833148.501524:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:3.0:1788833148.506697:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833148.506867:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256425472 00000100:00100000:2.0:1788833148.506881:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256425472 00000100:00100000:2.0:1788833148.506972:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:2.0:1788833148.506985:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10433:x1875727256425472:12345-192.168.206.55@tcp:103:lfs.0 00010000:00010000:2.0:1788833148.507006:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788833148.507090:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3fee47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af02 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.507117:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3feea2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af17 expref: 31 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.507136:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fed4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aec3 expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.507148:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833148.507161:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833148.507234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10433:x1875727256425472:12345-192.168.206.55@tcp:103:lfs.0 Request processed in 251us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.507242:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:1.0:1788833148.508934:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833148.508993:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256425600 00000100:00100000:2.0:1788833148.509004:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256425600 00000100:00100000:2.0:1788833148.509096:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 66 00000100:00100000:2.0:1788833148.509107:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10433:x1875727256425600:12345-192.168.206.55@tcp:58:lfs.0 00010000:00010000:2.0:1788833148.509273:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.509292:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.509318:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788833148.510123:0:8616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788833148.510338:0:8616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788833148.510413:0:8616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788833148.510557:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10433:x1875727256425600:12345-192.168.206.55@tcp:58:lfs.0 Request processed in 1446us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.510567:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 66 00000100:00100000:0.0:1788833148.527098:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265888128:0@lo:400:kworker.0 00000100:00100000:1.0:1788833148.527173:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265887872:0@lo:400:kworker.0 00000100:00100000:1.0:1788833148.527214:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833148.527214:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833148.527272:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265888128 00000100:00100000:2.0:1788833148.527283:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265888128 00000100:00100000:2.0:1788833148.527360:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788833148.527372:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265888128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833148.527552:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0674ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265887744:0@lo:400:kworker.0 00000100:00100000:1.0:1788833148.528532:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0674aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265888384:0@lo:400:kworker.0 00000100:00100000:1.0:1788833148.528586:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833148.528628:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833148.528636:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265888000:0@lo:400:kworker.0 00000100:00100000:1.0:1788833148.528692:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833148.530021:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265888128:12345-0@lo:400:kworker.0 Request processed in 2641us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.530052:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788833148.530096:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265888384 00000100:00100000:2.0:1788833148.530106:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265888384 00000100:00100000:2.0:1788833148.530174:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788833148.530184:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1875727265888384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833148.530249:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1875727265888384:12345-0@lo:400:kworker.0 Request processed in 67us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.530255:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788833148.530279:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265887872 00000100:00100000:2.0:1788833148.530283:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265887872 00000100:00100000:2.0:1788833148.530312:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265888000 00000100:00100000:2.0:1788833148.530315:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265888000 00000100:00100000:1.0:1788833148.530323:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0674aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265888384:0@lo:400:kworker.0 00000100:00100000:2.0:1788833148.530337:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788833148.530367:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265887872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833148.530408:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265887872:12345-0@lo:400:kworker.0 Request processed in 47us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833148.530415:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788833148.530424:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265888000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833148.530460:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265888000:12345-0@lo:400:kworker.0 Request processed in 38us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833148.531073:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833148.531136:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265888256:0@lo:400:kworker.0 00000100:00100000:3.0:1788833148.531180:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833148.531270:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833148.531292:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788833148.531303:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788833148.531430:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265888256 00000100:00100000:3.0:1788833148.531437:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265888256 00000100:00100000:2.0:1788833148.531580:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788833148.531681:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265887744 00000100:00100000:2.0:1788833148.531686:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265887744 00000100:00100000:2.0:1788833148.531987:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788833148.531998:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265887744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833148.532088:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265887744:12345-0@lo:400:kworker.0 Request processed in 93us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.532095:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788833148.532146:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0674ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265887744:0@lo:400:kworker.0 00000100:00100000:2.0:1788833148.532174:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256425728 00000100:00100000:2.0:1788833148.532177:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256425728 00000100:00100000:2.0:1788833148.532201:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 67 00000100:00100000:2.0:1788833148.532207:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10435:x1875727256425728:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833148.532223:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833148.532248:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3feec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af25 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.532327:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.532345:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.532357:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.532390:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.532399:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.532405:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833148.533162:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265888128:0@lo:400:kworker.0 00000100:00080000:0.0:1788833148.533204:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788833148.533212:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788833148.533216:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833148.533291:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265888000:0@lo:400:kworker.0 00000100:00100000:0.0:1788833148.533307:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265887872:0@lo:400:kworker.0 00000100:00100000:1.0:1788833148.533911:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788833148.534175:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788833148.534192:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265888256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833148.534306:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265888256:12345-0@lo:400:kworker.0 Request processed in 121us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833148.534313:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:2.0:1788833148.534784:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534804:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534817:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833148.534870:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788833148.534875:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833148.534900:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534914:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534924:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534930:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534951:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534958:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833148.534963:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534972:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.534987:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833148.534991:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833148.534996:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535002:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3feecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535016:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535022:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535027:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535074:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036e00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833148.535078:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535094:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535104:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea1539ce00) 00010000:00010000:2.0:1788833148.535106:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833148.535109:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535115:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3feed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535165:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3feec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535181:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 30 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833148.535190:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea1539c500) 00010000:00010000:2.0:1788833148.535192:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833148.535194:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036c00, rc 0) 00000100:00100000:2.0:1788833148.535260:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10435:x1875727256425728:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 3052us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833148.535268:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 67 00000100:00100000:1.0:1788833148.535410:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265888256:0@lo:400:kworker.0 00010000:00010000:2.0:1788833148.909174:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833149.038200:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265888512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833149.038270:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833149.038391:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0674ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265888640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833149.038422:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833149.038460:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265888512 00000100:00100000:2.0:1788833149.038474:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265888512 00000100:00100000:2.0:1788833149.038519:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265888640 00000100:00100000:2.0:1788833149.038523:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265888640 00000100:00100000:2.0:1788833149.038539:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788833149.038547:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265888512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833149.038580:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833149.043566:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265888512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5012us (5287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833149.043580:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788833149.043626:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788833149.043639:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265888640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833149.043682:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833149.043737:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265888640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (5314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833149.043743:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788833149.043790:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0674ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265888640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833149.046006:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265888512:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788833149.229263:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833149.229285:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833149.229346:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788833149.229354:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788833149.229482:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265888768:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788833149.229587:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1fc76240 going to sleep for 11 seconds 00000100:00100000:1.0:1788833149.232843:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265888768:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788833149.233617:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.233721:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256425856 00000100:00100000:0.0:1788833149.233728:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256425856 00000100:00100000:0.0:1788833149.233787:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:0.0:1788833149.233797:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10446:x1875727256425856:12345-192.168.206.55@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788833149.233865:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10446:x1875727256425856:12345-192.168.206.55@tcp:900:lhsmtool_posix.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833149.233872:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00080000:2.0:1788833149.233963:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833149.237396:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833149.237484:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256425984 00000100:00100000:1.0:1788833149.237494:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256425984 00000100:00100000:1.0:1788833149.237551:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:1.0:1788833149.237562:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10446:x1875727256425984:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788833149.237591:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788833149.237710:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10446:x1875727256425984:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 149us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833149.237719:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:3.0:1788833149.241446:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.241568:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256426112 00000100:00100000:0.0:1788833149.241581:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256426112 00000100:00100000:0.0:1788833149.241671:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:0.0:1788833149.241685:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10446:x1875727256426112:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788833149.241784:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.241806:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.241822:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242116:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242140:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242152:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242189:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242198:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242205:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833149.242249:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788833149.242254:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833149.242268:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242280:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242286:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242294:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242330:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.242335:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242342:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242355:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:0.0:1788833149.242359:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833149.242363:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242369:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3feee1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242383:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242390:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242396:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242401:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.242409:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242415:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242674:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9cea08db1600) 00010000:00010000:0.0:1788833149.242677:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833149.242681:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242687:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3feee8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242703:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242709:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242715:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242721:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ba00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.242724:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242729:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242737:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea1539c500) 00010000:00010000:0.0:1788833149.242739:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833149.242742:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.242748:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3feeef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.242919:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10446:x1875727256426112:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 Request processed in 1233us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833149.242930:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:2.0:1788833149.247360:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.248285:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256426368 00000100:00100000:0.0:1788833149.248299:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256426368 00000100:00100000:0.0:1788833149.248381:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:0.0:1788833149.248393:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10446:x1875727256426368:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833149.248414:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833149.248437:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3feef6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af2c expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.248540:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.248556:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249188:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833149.249203:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788833149.249311:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249319:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249325:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249350:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.249355:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249363:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249376:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea1539c500) 00010000:00010000:0.0:1788833149.249379:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833149.249384:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249390:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3feefd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249435:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3feef6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af2c expref: 32 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249445:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:0.0:1788833149.249447:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833149.249450:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3feef6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af2c expref: 32 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.249460:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925be00, rc 0) 00000100:00100000:0.0:1788833149.249523:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10446:x1875727256426368:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 1131us (2171us total) trans 4294967352 rc 301/301 00000100:00100000:0.0:1788833149.249532:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:3.0:1788833149.259780:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.259879:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256426496 00000100:00100000:0.0:1788833149.259910:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256426496 00000100:00100000:0.0:1788833149.259978:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 71 00000100:00100000:0.0:1788833149.259988:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10446:x1875727256426496:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788833149.260244:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788833149.260372:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10446:x1875727256426496:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 385us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833149.260380:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 71 00000100:00100000:3.0:1788833149.263524:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.265753:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256426752 00000100:00100000:0.0:1788833149.265766:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256426752 00000100:00100000:0.0:1788833149.265828:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 72 00000100:00100000:0.0:1788833149.265841:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10446:x1875727256426752:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833149.265862:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833149.265867:0:11926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788833149.265892:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feeb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af1e expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.265911:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833149.265915:0:11926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833149.265929:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af33 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788833149.266597:0:11926:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788833149.266868:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3fef12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.266883:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3fef12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.266904:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3fef12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.266963:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af33 expref: 33 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.266979:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3fef12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af33 expref: 32 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.266988:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea08db1600) 00010000:00010000:0.0:1788833149.266992:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833149.266994:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a600, rc 0) 00000100:00100000:0.0:1788833149.267087:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10446:x1875727256426752:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 1249us (3577us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788833149.267096:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 72 00000100:00100000:1.0:1788833149.284991:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.285123:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256427008 00000100:00100000:0.0:1788833149.285132:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256427008 00000100:00100000:0.0:1788833149.285192:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 73 00000100:00100000:0.0:1788833149.285203:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10446:x1875727256427008:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788833149.285254:0:8616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833149.285281:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3fef12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af33 expref: 32 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285298:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea08db1600) 00010000:00010000:0.0:1788833149.285322:0:8616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833149.285343:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285370:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285380:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285438:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285447:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285453:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285644:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285662:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285669:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285675:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925be00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.285679:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285687:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285696:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833149.285705:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833149.285710:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285716:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3fef20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285727:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285733:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285739:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285744:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ba00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.285747:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285752:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285760:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc1d7959f (ffff9cea08db1b00) 00010000:00010000:0.0:1788833149.285762:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833149.285765:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.285770:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fef27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc1d7959f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.285854:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10446:x1875727256427008:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 652us (871us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788833149.285867:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 73 00000100:00100000:1.0:1788833149.293321:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.293688:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256427136 00000100:00100000:3.0:1788833149.293698:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256427136 00000100:00100000:3.0:1788833149.293751:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:3.0:1788833149.293760:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10446:x1875727256427136:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833149.293778:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833149.293798:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af3a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.293830:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.293843:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.293854:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.293939:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.293957:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.293965:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:3.0:1788833149.293968:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788833149.293971:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833149.294025:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10446:x1875727256427136:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 266us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833149.294112:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:1.0:1788833149.300976:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.301096:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256427392 00000100:00100000:3.0:1788833149.301114:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256427392 00000100:00100000:3.0:1788833149.301202:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:3.0:1788833149.301214:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10446:x1875727256427392:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788833149.301322:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.301344:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.301358:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788833149.303087:0:11926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788833149.303112:0:11926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 283369080194ns, next at 284369076020ns, rc = 0 00000004:00010000:3.0:1788833149.303564:0:11926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb1cbb0d reply state 000000009c4e5cf0 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833149.303580:0:11926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788833149.303758:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10446:x1875727256427392:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 2539us (2782us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788833149.303771:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:3.0:1788833149.317934:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.317996:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256427520 00000100:00100000:3.0:1788833149.318010:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256427520 00000100:00100000:3.0:1788833149.318234:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 76 00000100:00100000:3.0:1788833149.318261:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10446:x1875727256427520:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833149.318290:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833149.318318:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af41 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.318397:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 35 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.318415:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 35 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.318440:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:3.0:1788833149.318444:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788833149.318448:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd200, rc 0) 00000100:00100000:3.0:1788833149.318725:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10446:x1875727256427520:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 465us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833149.318733:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 76 00010000:00010000:0.0:1788833149.319330:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.319349:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.319356:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.319363:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dca00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.319368:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.319375:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.319392:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:0.0:1788833149.319395:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788833149.319399:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.319406:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3fef3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833149.321758:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.321818:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256427648 00000100:00100000:3.0:1788833149.321829:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256427648 00000100:00100000:3.0:1788833149.321877:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:3.0:1788833149.321886:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875727256427648:12345-192.168.206.55@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788833149.321924:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1788833149.321966:0:8426:0:(genops.c:1385:class_connect()) connect: client 458534c2-c478-4b32-bcda-93b4ecf625e9, cookie 0x8c08e876ed3fef4a 00002000:00100000:3.0:1788833149.321983:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 458534c2-c478-4b32-bcda-93b4ecf625e9/ffff9cea3f63b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788833149.321997:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1788833149.322463:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788833149.322568:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9cea3f639800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833149.322725:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2356:x1875727256427648:12345-192.168.206.55@tcp:8:lhsmtool_posix.0 Request processed in 837us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833149.322734:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:3.0:1788833149.325081:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.325282:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256427776 00000100:00100000:3.0:1788833149.325292:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256427776 00000100:00100000:3.0:1788833149.325407:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:3.0:1788833149.325420:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:0:x1875727256427776:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788833149.330660:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788833149.442278:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:0:x1875727256427776:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 116845us (117203us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788833149.442295:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 26 00000001:00080000:2.0:1788833149.442359:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788833149.442375:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000100:00100000:0.0:1788833149.445175:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.445805:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256428032 00000100:00100000:3.0:1788833149.445822:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256428032 00000100:00100000:1.0:1788833149.447711:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:1.0:1788833149.447740:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10446:x1875727256428032:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788833149.453847:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10446:x1875727256428032:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 6101us (8662us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788833149.453865:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:3.0:1788833149.477275:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.477325:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256428288 00000100:00100000:3.0:1788833149.477338:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256428288 00000100:00100000:3.0:1788833149.477422:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 77 00000100:00100000:3.0:1788833149.477436:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10446:x1875727256428288:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788833149.477584:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10446:x1875727256428288:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 151us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833149.477593:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 77 00000100:00100000:3.0:1788833149.486501:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833149.486750:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256428416 00000100:00100000:2.0:1788833149.486763:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256428416 00000100:00100000:2.0:1788833149.486831:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 78 00000100:00100000:2.0:1788833149.486842:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10446:x1875727256428416:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833149.486883:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833149.486907:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fef51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af48 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.487111:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fef58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.487129:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fef58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.487148:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fef58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833149.487256:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833149.487285:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fef58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.487317:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3fef51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af48 expref: 37 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.487337:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fef58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af48 expref: 36 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.487347:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:2.0:1788833149.487350:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788833149.487354:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037600, rc 0) 00000100:00100000:2.0:1788833149.487474:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+36:10446:x1875727256428416:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 633us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833149.487484:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 78 00000100:00100000:3.0:1788833149.510633:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833149.510735:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256428544 00000100:00100000:1.0:1788833149.510750:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256428544 00000100:00100000:1.0:1788833149.510823:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:1.0:1788833149.510834:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256428544:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833149.510852:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833149.510874:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af4f expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833149.510904:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6d7d, blocks: 0x1 00010000:00010000:1.0:1788833149.510925:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=283s v=(0 0) 00010000:00010000:1.0:1788833149.510930:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833149.510941:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.510961:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.510995:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fc00, rc 0) 00000100:00100000:1.0:1788833149.511090:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256428544:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 257us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833149.511100:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:3.0:1788833149.528023:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833149.528131:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256428800 00000100:00100000:1.0:1788833149.528141:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256428800 00000100:00100000:1.0:1788833149.528198:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:1.0:1788833149.528208:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+36:10446:x1875727256428800:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788833149.528293:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+36:10446:x1875727256428800:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833149.528301:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:3.0:1788833149.541143:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.541278:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256428928 00000100:00100000:0.0:1788833149.541294:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256428928 00000100:00100000:0.0:1788833149.541377:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:0.0:1788833149.541390:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:10446:x1875727256428928:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833149.541423:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833149.541452:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af56 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.541492:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.541503:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833149.541508:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833149.541514:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.541563:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.541580:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 7 pid: 8426 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.541597:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0352a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1875727265888896:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833149.541745:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f221000 going to sleep for 11 seconds 00000100:00100000:3.0:1788833149.561489:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.561564:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0352a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1875727265888896:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833149.561612:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833149.561613:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256429056 00000100:00100000:2.0:1788833149.561625:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256429056 00010000:00010000:0.0:1788833149.561658:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925be00, rc 0) 00010000:00010000:2.0:1788833149.561680:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 8 pid: 8426 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833149.561736:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:2.0:1788833149.561748:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256429056:12345-192.168.206.55@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788833149.561761:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:10446:x1875727256428928:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 20370us (20626us total) trans 0 rc 0/0 00010000:00010000:2.0:1788833149.561763:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788833149.561778:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 28 00010000:00010000:2.0:1788833149.561795:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 8 pid: 8426 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.561814:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 7 pid: 8426 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.561845:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f81785/0x8c08e876ed3fef5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af4f expref: 7 pid: 8426 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.561862:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833149.561867:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833149.561877:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.561887:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.561924:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833149.561953:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06748700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1875727265889024:192.168.206.55@tcp:105: 00000100:00100000:2.0:1788833149.562020:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833149.573371:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.573451:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256429184 00000100:00100000:3.0:1788833149.573460:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256429184 00002000:00100000:3.0:1788833149.573541:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cea06748e00 x1875727256429184/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:335/0 lens 504/0 e 0 to 0 dl 1788833160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833149.573553:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea06748e00 with x1875727256429184 ext(0->8) 00002000:00010000:3.0:1788833149.573559:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea06748e00 00000100:00100000:0.0:1788833149.573675:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06748700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1875727265889024:192.168.206.55@tcp:105: 00010000:00010000:0.0:1788833149.573708:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833149.573732:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833149.573750:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256429184:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788833149.573787:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256429056:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 12038us (12303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833149.573802:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:3.0:1788833149.574461:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256429184:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 Request processed in 714us (1096us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788833149.574471:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00002000:00100000:3.0:1788833149.574479:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cea06748e00 x1875727256429184/t4294967302(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:335/0 lens 504/448 e 0 to 0 dl 1788833160 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833149.574488:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea06748e00 with x1875727256429184 ext(0->8) 00002000:00010000:3.0:1788833149.574492:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea06748e00 00000100:00100000:3.0:1788833149.581774:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.581830:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256429312 00000100:00100000:3.0:1788833149.581839:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256429312 00000100:00100000:3.0:1788833149.581906:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:3.0:1788833149.581920:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+36:10446:x1875727256429312:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 00000040:00080000:1.0:1788833149.611521:0:11966:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833149.611540:0:11966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833149.611823:0:11966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788833149.611831:0:11966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788833149.685197:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000001:00080000:2.0:1788833149.685233:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:2.0:1788833149.685260:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788833149.685272:0:5835:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1788833149.685767:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265889152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788833149.685854:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833149.685989:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:10446:x1875727256429312:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 Request processed in 104069us (104223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833149.686000:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:3.0:1788833149.688977:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265889152 00000100:00100000:3.0:1788833149.688992:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265889152 00000100:00100000:3.0:1788833149.689078:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788833149.689090:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265889152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788833149.689269:0:6654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788833149.689273:0:6654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788833149 00002000:00010000:3.0:1788833149.689276:0:6654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788833149.689286:0:6654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788833149 -> 1788833149 00002000:00010000:3.0:1788833149.689289:0:6654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788833149.689363:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875727265889152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (3507us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788833149.689371:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788833149.689779:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea06749880/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788833149.689787:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea06749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265889152:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788833149.692094:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788833149.692112:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788833149.695140:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833149.695199:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256429440 00000100:00100000:2.0:1788833149.695209:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256429440 00000100:00100000:2.0:1788833149.695270:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:2.0:1788833149.695280:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256429440:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788833149.749641:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256429440:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 Request processed in 54353us (54499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833149.749666:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 30 00000001:00080000:0.0:1788833149.749716:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788833149.749726:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788833149.755012:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833149.755218:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256429696 00000100:00100000:1.0:1788833149.755229:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256429696 00000100:00100000:1.0:1788833149.755287:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 81 00000100:00100000:1.0:1788833149.755298:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+13:10446:x1875727256429696:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788833149.755355:0:11926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833149.755384:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3fef58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af48 expref: 13 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.755411:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:1.0:1788833149.755417:0:11926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833149.755482:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.755496:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.755508:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788833149.755777:0:11926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a927914 reply state 0000000053e14f87 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833149.755787:0:11926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833149.756363:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+14:10446:x1875727256429696:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 1064us (1357us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788833149.756371:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 81 00000100:00100000:2.0:1788833149.760437:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00010000:00010000:2.0:1788833149.760473:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.760485:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.760508:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.760514:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833149.760518:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.760526:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.760542:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:2.0:1788833149.760544:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833149.760549:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.760751:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fef6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833149.760842:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256429824 00000100:00100000:3.0:1788833149.760851:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256429824 00000100:00100000:3.0:1788833149.760903:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:3.0:1788833149.760913:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256429824:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788833149.761849:0:6654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788833149.761854:0:6654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788833149 -> 1788833147 00002000:00010000:3.0:1788833149.761857:0:6654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788833146 00002000:00010000:3.0:1788833149.761859:0:6654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788833149 -> 1788833147 00002000:00010000:3.0:1788833149.761861:0:6654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788833149.761995:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2360:x1875727256429824:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 1080us (1561us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788833149.762004:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:2.0:1788833149.764078:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833149.764122:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256430080 00000100:00100000:3.0:1788833149.764132:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256430080 00000100:00100000:3.0:1788833149.764188:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00100000:3.0:1788833149.764198:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+13:10446:x1875727256430080:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788833149.764259:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.764275:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.764295:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.764328:0:8616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.764342:0:8616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 13 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833149.764355:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265889280:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833149.764438:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788833149.767873:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265889280:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833149.767902:0:8616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833149.770132:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.770224:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256430208 00000100:00100000:0.0:1788833149.770234:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256430208 00010000:00010000:0.0:1788833149.770274:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 14 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.770314:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:0.0:1788833149.770325:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:2358:x1875727256430208:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833149.770339:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833149.770346:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 14 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.770359:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 14 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.770382:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fef35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af3a expref: 14 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.770406:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:0.0:1788833149.770411:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.770421:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.770428:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.770456:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833149.770504:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:2358:x1875727256430208:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 180us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833149.770512:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 43 00010000:00010000:3.0:1788833149.773658:0:8616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773674:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773707:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773715:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773723:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773730:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833149.773735:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773752:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773769:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:3.0:1788833149.773772:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788833149.773777:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.773783:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833149.773877:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+12:10446:x1875727256430080:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 Request processed in 9676us (9802us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788833149.773887:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00100000:3.0:1788833149.776479:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833149.776563:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256430336 00000100:00100000:1.0:1788833149.776573:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256430336 00000100:00100000:1.0:1788833149.776640:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:1.0:1788833149.776663:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256430336:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788833149.776705:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.776725:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.776745:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833149.776749:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833149.776754:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.776788:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.776802:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 7 pid: 6656 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833149.776816:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1875727265889408:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833149.777219:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f4056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833149.783235:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1875727265889408:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833149.783263:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833149.795178:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833149.795256:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256430464 00000100:00100000:1.0:1788833149.795265:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256430464 00010000:00010000:1.0:1788833149.795302:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 8 pid: 6656 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833149.795346:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:1.0:1788833149.795356:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2358:x1875727256430464:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833149.795383:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833149.795404:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 8 pid: 6656 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795418:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 8 pid: 6656 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795441:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45faadd/0x8c08e876ed3fef66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af56 expref: 8 pid: 6656 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795457:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833149.795461:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833149.795466:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795475:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795501:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833149.795546:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256430464:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 191us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833149.795553:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 44 00010000:00010000:1.0:1788833149.795579:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795588:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795618:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795626:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795749:0:6656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795757:0:6656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833149.795761:0:6656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795769:0:6656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795782:0:6656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833149.795790:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020482e16/0x8c08e876ed3fef7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833149.795883:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256430336:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 Request processed in 19223us (19422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833149.795892:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:3.0:1788833149.802791:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.803552:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256430720 00000100:00100000:0.0:1788833149.803562:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256430720 00000100:00100000:0.0:1788833149.803618:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:0.0:1788833149.803628:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+12:10446:x1875727256430720:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788833149.803715:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.803731:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.803741:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.803943:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.803962:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.803971:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.804005:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.804019:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 13 pid: 5811 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.804050:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0352a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265889536:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833149.804136:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833149.807251:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0352a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265889536:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833149.807280:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833149.808162:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833149.808590:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256430848 00000100:00100000:0.0:1788833149.808598:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256430848 00010000:00010000:0.0:1788833149.808633:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 14 pid: 5811 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.808685:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:0.0:1788833149.808694:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:2357:x1875727256430848:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833149.808707:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833149.808722:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 14 pid: 5811 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.808735:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 14 pid: 5811 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.808756:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fef43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af41 expref: 14 pid: 5811 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.808771:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:0.0:1788833149.808776:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.808785:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.808792:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.808825:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833149.808863:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833149.808873:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.808878:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:2357:x1875727256430848:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 183us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833149.808888:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 45 00000001:00080000:3.0:1788833149.809103:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788833149.813596:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788833149.813667:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788833149.813772:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1875727265889664:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788833149.813835:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833149.813883:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833149.813938:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265889664 00000100:00100000:0.0:1788833149.813946:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265889664 00000100:00100000:0.0:1788833149.814000:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833149.814009:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875727265889664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788833149.814098:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875727265889664:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833149.814116:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788833149.814155:0:5812:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788833149.814161:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea06749880, transno 4294967303 00000100:00100000:2.0:1788833149.814184:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1875727265889664:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788833149.814849:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788833149.814910:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1875727265889792:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788833149.814953:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833149.814980:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833149.814998:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265889792 00000100:00100000:2.0:1788833149.815002:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265889792 00000100:00100000:2.0:1788833149.815057:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833149.815066:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875727265889792:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788833149.815243:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5812:x1875727265889792:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (289us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788833149.815251:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833149.815570:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1875727265889792:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788833149.815598:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815608:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815615:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815621:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.815626:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815634:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815662:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea32de4500) 00010000:00010000:0.0:1788833149.815665:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833149.815670:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815676:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fef89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815719:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815725:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815743:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815748:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.815751:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815757:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815766:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea1539c500) 00010000:00010000:0.0:1788833149.815768:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833149.815771:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815777:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3feebe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815798:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815812:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815822:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815847:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.815874:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 16 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.815887:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0352a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265889920:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833149.815972:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833149.819454:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833149.819570:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256430976 00000100:00100000:2.0:1788833149.819579:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256430976 00010000:00010000:2.0:1788833149.819638:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 17 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833149.819683:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:2.0:1788833149.819693:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+17:2358:x1875727256430976:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833149.819717:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833149.819724:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 17 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.819736:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 17 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.819770:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea1539c500) 00010000:00010000:2.0:1788833149.819776:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.819786:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.819794:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.819812:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833149.819859:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+17:2358:x1875727256430976:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 167us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833149.819867:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 46 00010000:00010000:0.0:1788833149.819879:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3feeda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af25 expref: 17 pid: 5813 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.819898:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0352a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265889920:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833149.819919:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819929:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819934:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819944:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819950:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819957:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819964:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.819975:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819983:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.819993:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea1539c500) 00010000:00010000:0.0:1788833149.819995:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833149.819999:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820005:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fef90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820015:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820021:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820028:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820050:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833149.820053:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820059:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820066:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea1539c500) 00010000:00010000:0.0:1788833149.820069:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788833149.820078:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.820085:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fef82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833149.820268:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+15:10446:x1875727256430720:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 16640us (17486us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1788833149.820276:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 83 00000020:00080000:0.0:1788833149.820280:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788833149.820551:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788833149.820556:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788833149.820588:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788833149.820594:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788833149.823983:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833149.824117:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256431232 00000100:00100000:2.0:1788833149.824128:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256431232 00000100:00100000:2.0:1788833149.824189:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:2.0:1788833149.824199:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+15:10446:x1875727256431232:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788833149.825024:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788833149.825182:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:2.0:1788833149.825230:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.825246:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.825265:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.825273:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.825279:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.825284:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833149.825308:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788833149.825390:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+17:10446:x1875727256431232:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 1191us (1414us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788833149.825398:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000020:00080000:2.0:1788833149.825403:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788833149.825546:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833149.825554:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.825561:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833149.825565:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.825574:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.825586:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cea1539c700) 00010000:00010000:0.0:1788833149.825589:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788833149.825593:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.825599:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3fef97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833149.825616:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833149.825618:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833149.825621:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833149.933946:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833150.837855:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833150.837865:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833150.837899:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788833150.837907:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788833150.957242:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788833151.671158:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1788833151.671182:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000040:00080000:2.0:1788833151.674831:0:12020:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788833151.674839:0:12020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788833151.674874:0:12020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788833151.674879:0:12020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788833151.802757:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833151.802803:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256431488 00000100:00100000:3.0:1788833151.802812:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256431488 00000100:00100000:3.0:1788833151.802886:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00100000:3.0:1788833151.802900:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+17:10465:x1875727256431488:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833151.802922:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833151.802943:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.803066:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3fefa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.803080:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3fefa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.803091:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3fefa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833151.803102:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788833151.803240:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fef9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af5d expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.803261:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3fefa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af5d expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.803271:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:3.0:1788833151.803275:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788833151.803278:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd000, rc 0) 00000100:00100000:3.0:1788833151.803335:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10465:x1875727256431488:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 439us (588us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788833151.803361:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00080000:3.0:1788833151.803392:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833151.811319:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833151.811554:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256431616 00000100:00100000:0.0:1788833151.811565:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256431616 00000100:00100000:0.0:1788833151.811627:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 85 00000100:00100000:0.0:1788833151.811649:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10465:x1875727256431616:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:0.0:1788833151.811743:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.811761:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.811773:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.811789:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.811797:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.811998:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812280:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812289:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812296:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788833151.812335:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812357:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812362:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812369:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812375:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833151.812380:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812388:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812400:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833151.812404:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833151.812408:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812415:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fefb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812427:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812434:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812441:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812453:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833151.812457:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812463:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812474:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea08db1800) 00010000:00010000:0.0:1788833151.812477:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833151.812480:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812486:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3fefba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812501:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812507:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812513:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812518:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833151.812521:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812527:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812546:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1600) 00010000:00010000:0.0:1788833151.812549:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833151.812552:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833151.812559:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3fefc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833151.812655:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10465:x1875727256431616:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 1017us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833151.812664:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 85 00000100:00100000:3.0:1788833151.857053:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833151.857096:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256431872 00000100:00100000:3.0:1788833151.857105:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256431872 00000100:00100000:3.0:1788833151.857147:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 86 00000100:00100000:3.0:1788833151.857156:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10468:x1875727256431872:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833151.857175:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833151.857201:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fefc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af64 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.857267:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.857282:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.857291:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.857306:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.857312:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.857319:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862562:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862664:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862677:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833151.862691:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788833151.862898:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862906:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862913:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862918:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833151.862922:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862929:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862940:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:3.0:1788833151.862943:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833151.862947:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862953:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3fefcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862966:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862978:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862984:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862989:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833151.862992:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.862998:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.863007:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea32de4300) 00010000:00010000:3.0:1788833151.863009:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833151.863012:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.863018:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3fefd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.863246:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3fefc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.863263:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.863271:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:3.0:1788833151.863273:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833151.863282:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833151.863851:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10468:x1875727256431872:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 6692us (6821us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788833151.863859:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 86 00000100:00100000:3.0:1788833151.868877:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833151.869670:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256432000 00000100:00100000:1.0:1788833151.869680:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256432000 00000100:00100000:1.0:1788833151.869734:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 87 00000100:00100000:1.0:1788833151.869744:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10468:x1875727256432000:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:1.0:1788833151.869808:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869824:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869835:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869857:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869864:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869870:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869875:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833151.869879:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869885:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869911:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:1.0:1788833151.869914:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788833151.869918:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.869924:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fefeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833151.869998:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10468:x1875727256432000:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 255us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833151.870006:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 87 00000100:00100000:0.0:1788833151.878284:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833151.878318:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256432256 00000100:00100000:0.0:1788833151.878328:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256432256 00000100:00100000:0.0:1788833151.878388:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:0.0:1788833151.878402:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10468:x1875727256432256:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833151.888212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+22:10468:x1875727256432256:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 9794us (9994us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788833151.888224:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:0.0:1788833151.936825:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833151.937117:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256432512 00000100:00100000:1.0:1788833151.937126:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256432512 00000100:00100000:1.0:1788833151.937175:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 88 00000100:00100000:1.0:1788833151.937185:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+22:9988:x1875727256432512:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1788833151.937207:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833151.937227:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feff2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af6b expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.937331:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.937347:0:11926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.937355:0:11926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.937386:0:11926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.937410:0:11926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 23 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833151.937424:0:11926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265890048:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833151.937509:0:11926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f4056c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833151.943148:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833151.943503:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256432640 00000100:00100000:2.0:1788833151.943515:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256432640 00010000:00010000:2.0:1788833151.943556:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 24 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833151.943598:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:2.0:1788833151.943608:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+24:2358:x1875727256432640:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833151.943646:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833151.943653:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 24 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.943666:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 24 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.943690:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:2.0:1788833151.943695:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.943704:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.943711:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.943736:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833151.943795:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+24:2358:x1875727256432640:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 189us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833151.943803:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 47 00010000:00010000:1.0:1788833151.944462:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3fefdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af64 expref: 23 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833151.944646:0:11926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265890048:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833151.944673:0:11926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.944682:0:11926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.944687:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833151.944706:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788833151.946651:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3feff2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 24 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.946679:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 23 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833151.946689:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:1.0:1788833151.946709:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833151.946713:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932ea00, rc 0) 00000100:00100000:0.0:1788833151.949146:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+23:9988:x1875727256432512:12345-192.168.206.55@tcp:101:bash.0 Request processed in 11948us (12313us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788833151.949160:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 88 00000100:00100000:0.0:1788833151.955170:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833151.955435:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256432896 00000100:00100000:3.0:1788833151.955445:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256432896 00000100:00100000:3.0:1788833151.955540:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 89 00000100:00100000:3.0:1788833151.955550:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+23:9988:x1875727256432896:12345-192.168.206.55@tcp:36:bash.0 00010000:00010000:3.0:1788833151.955816:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.955833:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.955843:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788833151.955902:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:3.0:1788833151.955927:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fd0e2bf reply state 00000000a8554302 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833151.955935:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788833151.955980:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:3.0:1788833151.956102:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+27:9988:x1875727256432896:12345-192.168.206.55@tcp:36:bash.0 Request processed in 553us (941us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788833151.956110:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 89 00000020:00080000:3.0:1788833151.956115:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788833151.959072:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833151.959193:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256433024 00000100:00100000:2.0:1788833151.959202:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256433024 00010000:00010000:3.0:1788833151.959229:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.959251:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833151.959256:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:2.0:1788833151.959267:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+27:9988:x1875727256433024:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1788833151.959288:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833151.959306:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff00e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af72 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.959335:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.959343:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833151.959348:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.959356:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.959372:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:3.0:1788833151.959375:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833151.959380:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.959386:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff007 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.959391:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af72 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.959407:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af72 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833151.959427:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:2.0:1788833151.959430:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833151.959433:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037c00, rc 0) 00000100:00100000:2.0:1788833151.959496:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+27:9988:x1875727256433024:12345-192.168.206.55@tcp:101:bash.0 Request processed in 231us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833151.959503:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:2.0:1788833151.963011:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833151.963144:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256433152 00000100:00100000:3.0:1788833151.963154:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256433152 00000100:00100000:3.0:1788833151.963274:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:3.0:1788833151.963285:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:9988:x1875727256433152:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833151.963302:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833151.963322:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af79 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833151.963350:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f6d7b, atime: 0x6a9f6d7a, ctime: 0x6a9f6d7b, blocks: 0xb 00010000:00010000:3.0:1788833151.963385:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1788833151.963391:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833151.963400:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 7 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833151.963431:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 7 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788833151.963547:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788833151.963805:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dce00, rc 0) 00000100:00100000:3.0:1788833151.963909:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:9988:x1875727256433152:12345-192.168.206.55@tcp:101:bash.0 Request processed in 625us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833151.963917:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:3.0:1788833151.972208:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833151.973094:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256433280 00000100:00100000:1.0:1788833151.973105:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256433280 00002000:00010000:1.0:1788833151.973140:0:6659:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788833151.973144:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea40fb3480 with x1875727256433280 ext(0->18446744073709551615) 00002000:00010000:1.0:1788833151.973154:0:6659:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea40fb3480. 00000100:00100000:1.0:1788833151.973390:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:1.0:1788833151.973405:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256433280:12345-192.168.206.55@tcp:10:bash.0 00002000:00010000:1.0:1788833151.974264:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788833151.974270:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788833147 -> 1788833151 00002000:00010000:1.0:1788833151.974273:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788833146 -> 1788833146 00002000:00010000:1.0:1788833151.974275:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788833147 -> 1788833151 00002000:00010000:1.0:1788833151.974278:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788833151.974344:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256433280:12345-192.168.206.55@tcp:10:bash.0 Request processed in 944us (2144us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788833151.974352:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00002000:00010000:1.0:1788833151.974357:0:6659:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788833151.974360:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea40fb3480 with x1875727256433280 ext(0->18446744073709551615) 00002000:00010000:1.0:1788833151.974365:0:6659:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea40fb3480. 00010000:00010000:0.0:1788833151.989336:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833152.067390:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.067572:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256433408 00000100:00100000:2.0:1788833152.067581:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256433408 00000100:00100000:2.0:1788833152.067684:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 91 00000100:00100000:2.0:1788833152.067695:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+27:10482:x1875727256433408:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:2.0:1788833152.067762:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.067790:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.067803:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.067817:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.067837:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.067844:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068068:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068078:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068086:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833152.068300:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068321:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068328:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068334:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068341:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.068345:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068353:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068372:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833152.068376:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.068380:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068387:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff01c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068399:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068405:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068410:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068415:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.068418:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068424:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068431:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea1539ce00) 00010000:00010000:2.0:1788833152.068433:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.068436:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068442:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff023 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068465:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068472:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068488:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068494:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.068497:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068504:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068512:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:2.0:1788833152.068514:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.068517:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.068523:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff02a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.068599:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+27:10482:x1875727256433408:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 903us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.068607:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 91 00000100:00100000:3.0:1788833152.137439:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.137788:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256433664 00000100:00100000:0.0:1788833152.137802:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256433664 00000100:00100000:0.0:1788833152.137944:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 92 00000100:00100000:0.0:1788833152.137957:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+27:10485:x1875727256433664:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833152.137983:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833152.138010:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af80 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138142:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138160:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138173:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138194:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138201:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138208:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138954:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138975:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.138995:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833152.139009:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788833152.139356:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139365:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139373:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139381:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833152.139387:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139395:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139413:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833152.139417:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833152.139422:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139430:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff038 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139446:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139452:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139466:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139471:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925aa00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833152.139474:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139481:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139489:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea08db1600) 00010000:00010000:0.0:1788833152.139492:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833152.139495:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139500:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff03f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139560:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af80 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139576:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af80 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.139584:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:0.0:1788833152.139586:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788833152.139589:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b200, rc 0) 00000100:00100000:0.0:1788833152.139935:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10485:x1875727256433664:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 1978us (2507us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788833152.139957:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 92 00000100:00100000:3.0:1788833152.143954:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.144733:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256433792 00000100:00100000:0.0:1788833152.144751:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256433792 00000100:00100000:0.0:1788833152.144830:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00100000:0.0:1788833152.144842:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10485:x1875727256433792:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:0.0:1788833152.144933:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.144954:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 29 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.144966:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.145011:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 29 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.145027:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 29 pid: 11926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.145681:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0352a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265890176:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833152.145875:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833152.152596:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833152.154118:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256434048 00000100:00100000:1.0:1788833152.154138:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256434048 00000100:00100000:1.0:1788833152.154233:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:1.0:1788833152.154246:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+30:6056:x1875727256434048:12345-192.168.206.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788833152.155241:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:6056:x1875727256434048:12345-192.168.206.55@tcp:35:ldlm_bl.0 Request processed in 991us (2652us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788833152.155268:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:0.0:1788833152.157673:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0352a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265890176:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833152.157716:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833152.160323:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.160440:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256434176 00000100:00100000:2.0:1788833152.160452:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256434176 00010000:00010000:2.0:1788833152.160580:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 31 pid: 11926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.160674:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:2.0:1788833152.160686:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:2358:x1875727256434176:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833152.160706:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833152.160715:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 31 pid: 11926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.160731:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 31 pid: 11926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.160758:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3feff9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af6b expref: 31 pid: 11926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.160780:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:2.0:1788833152.160787:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.160798:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.160807:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.161089:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833152.161170:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+30:2358:x1875727256434176:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 484us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.161181:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 48 00010000:00010000:3.0:1788833152.161974:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.161988:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.162110:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.162119:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.162147:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.162154:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833152.162159:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.162169:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.162184:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:3.0:1788833152.162188:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833152.162192:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.162199:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff054 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.162413:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10485:x1875727256433792:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 17568us (18469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.162430:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00100000:3.0:1788833152.164997:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.165211:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256434432 00000100:00100000:2.0:1788833152.165224:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256434432 00000100:00100000:2.0:1788833152.165291:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:2.0:1788833152.165302:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+29:10485:x1875727256434432:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:2.0:1788833152.165724:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10485:x1875727256434432:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 422us (738us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788833152.165733:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:0.0:1788833152.266357:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.266464:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256434688 00000100:00100000:2.0:1788833152.266476:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256434688 00000100:00100000:2.0:1788833152.267180:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:2.0:1788833152.267196:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+30:10496:x1875727256434688:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:2.0:1788833152.267228:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833152.267256:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff05b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af87 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.267353:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.267371:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.267385:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.267402:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.268615:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.268628:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.268988:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.268999:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.269007:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833152.269019:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788833152.270768:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.270789:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.270797:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.270803:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.270808:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.270815:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271732:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833152.271735:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.271742:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271750:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271771:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271779:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271785:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271790:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.271794:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271800:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271808:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea1539ce00) 00010000:00010000:2.0:1788833152.271810:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.271814:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271819:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.271985:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff05b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af87 expref: 33 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.272002:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af87 expref: 32 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.272011:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:2.0:1788833152.272013:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833152.272016:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037600, rc 0) 00000100:00100000:2.0:1788833152.272307:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10496:x1875727256434688:12345-192.168.206.55@tcp:101:cat.0 Request processed in 5113us (5964us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788833152.272317:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:0.0:1788833152.285362:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.285500:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256434944 00000100:00100000:2.0:1788833152.285514:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256434944 00000100:00100000:2.0:1788833152.285594:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:2.0:1788833152.285614:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10496:x1875727256434944:12345-192.168.206.55@tcp:35:cat.0 00000100:00100000:2.0:1788833152.285945:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+33:10496:x1875727256434944:12345-192.168.206.55@tcp:35:cat.0 Request processed in 339us (595us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788833152.285953:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:3.0:1788833152.316846:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.317078:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256435200 00000100:00100000:0.0:1788833152.317091:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256435200 00000100:00100000:0.0:1788833152.317166:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 95 00000100:00100000:0.0:1788833152.317178:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+33:10497:x1875727256435200:12345-192.168.206.55@tcp:36:rm.0 00010000:00010000:0.0:1788833152.317262:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788833152.317296:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af87 expref: 33 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317321:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af80 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317333:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff00e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af72 expref: 31 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317345:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea32de4f00) 00010000:00010000:0.0:1788833152.317357:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833152.317385:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317401:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317412:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317428:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317435:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.317461:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.318283:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.318299:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.318309:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833152.320270:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788833152.320290:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286386258166ns, next at 287386253241ns, rc = 0 00010000:00010000:0.0:1788833152.320385:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320406:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320419:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320429:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320436:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320443:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320812:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833152.320845:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320852:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320859:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320865:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925be00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833152.320870:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320879:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320893:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1800) 00010000:00010000:0.0:1788833152.320897:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788833152.320902:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320908:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff08c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320933:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320940:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320945:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320961:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833152.320964:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320969:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320979:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833152.320981:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833152.320984:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.320989:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff07e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788833152.321000:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f750294a reply state 00000000b61ef885 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.321010:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833152.321170:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+32:10497:x1875727256435200:12345-192.168.206.55@tcp:36:rm.0 Request processed in 3987us (4333us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788833152.321180:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 95 00010000:00010000:3.0:1788833152.324952:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833152.324975:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.324990:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833152.324995:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.325006:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.325070:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cea08db1800) 00010000:00010000:3.0:1788833152.325074:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788833152.325080:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.325087:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff093 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.325112:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833152.325114:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833152.325116:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833152.327698:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.327818:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.327827:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.327851:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.327856:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.327864:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.327883:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea08db1600) 00010000:00010000:2.0:1788833152.327886:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.327891:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.327898:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff085 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833152.387121:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.387738:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256435456 00000100:00100000:2.0:1788833152.387753:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256435456 00000100:00100000:2.0:1788833152.387832:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 96 00000100:00100000:2.0:1788833152.387845:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+31:10503:x1875727256435456:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1788833152.387876:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833152.387903:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff09a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af8e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.388073:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.388089:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.388117:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.388134:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.388142:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.388148:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788833152.388788:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788833152.388995:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389009:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389018:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389095:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389103:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389110:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389118:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.389130:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389138:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389153:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833152.389156:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.389161:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389168:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff0a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833152.389182:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b9113b8 reply state 000000004f0c869a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.389191:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788833152.389226:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff09a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 34 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389240:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.389247:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea1539c200) 00010000:00010000:2.0:1788833152.389250:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833152.389252:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036a00, rc 0) 00000100:00100000:2.0:1788833152.389331:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10503:x1875727256435456:12345-192.168.206.55@tcp:101:bash.0 Request processed in 1490us (2238us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788833152.389339:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 96 00010000:00010000:0.0:1788833152.402275:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.402304:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.402312:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.402338:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833152.402342:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.402349:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.402367:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea1539ce00) 00010000:00010000:0.0:1788833152.402370:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833152.402386:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.402393:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff0a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833152.402824:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.402890:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256435584 00000100:00100000:2.0:1788833152.402904:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256435584 00000100:00100000:2.0:1788833152.403001:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:2.0:1788833152.403014:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2357:x1875727256435584:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1788833152.403066:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833152.403091:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af95 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788833152.403125:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833152.403150:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1788833152.403155:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833152.403166:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 6 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.403188:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 6 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.403204:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037a00, rc 0) 00000100:00100000:2.0:1788833152.403279:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256435584:12345-192.168.206.55@tcp:101:bash.0 Request processed in 268us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.403287:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00080000:1.0:1788833152.403373:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833152.405737:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.406235:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256435712 00000100:00100000:0.0:1788833152.406249:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256435712 00000100:00100000:1.0:1788833152.406398:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:1.0:1788833152.406410:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:10503:x1875727256435712:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1788833152.406432:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833152.406455:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72af9c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.406509:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 7 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.406520:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833152.406525:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833152.406531:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.406575:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 7 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.406593:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 7 pid: 6655 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833152.406610:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875727265890304:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833152.406756:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f405cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833152.413253:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.413357:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256435840 00000100:00100000:2.0:1788833152.413370:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256435840 00010000:00010000:2.0:1788833152.413424:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 8 pid: 6655 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.413478:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:2.0:1788833152.413509:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256435840:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833152.413529:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833152.413556:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 8 pid: 6655 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.413579:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 8 pid: 6655 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.413621:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833152.413626:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833152.413645:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.413656:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.413705:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.413722:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265890432:192.168.206.55@tcp:105: 00000100:00100000:2.0:1788833152.413824:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f180 going to sleep for 11 seconds 00010000:00010000:1.0:1788833152.414365:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff0bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af95 expref: 8 pid: 6655 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833152.414396:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875727265890304:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833152.414427:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.414440:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fa00, rc 0) 00000100:00100000:1.0:1788833152.414492:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:10503:x1875727256435712:12345-192.168.206.55@tcp:101:bash.0 Request processed in 8073us (8772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833152.414501:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:2.0:1788833152.417968:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833152.418123:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256436096 00000100:00100000:3.0:1788833152.418137:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256436096 00000100:00100000:3.0:1788833152.418214:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:3.0:1788833152.418268:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+33:10503:x1875727256436096:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:3.0:1788833152.418764:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10503:x1875727256436096:12345-192.168.206.55@tcp:35:bash.0 Request processed in 537us (805us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788833152.418772:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:0.0:1788833152.420519:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265890432:192.168.206.55@tcp:105: 00010000:00010000:0.0:1788833152.420555:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833152.420639:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256435840:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 7123us (7391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.420650:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:2.0:1788833152.570347:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.570469:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256436224 00000100:00100000:0.0:1788833152.570493:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256436224 00000100:00100000:0.0:1788833152.570567:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 97 00000100:00100000:0.0:1788833152.570580:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+34:10519:x1875727256436224:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833152.570610:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833152.570663:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff0cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afa3 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.570749:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff0d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.570765:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.570779:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833152.570824:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788833152.570828:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833152.570846:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.570872:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff0cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afa3 expref: 36 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.570891:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afa3 expref: 35 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.570900:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833152.570903:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833152.570907:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ba00, rc 0) 00000100:00100000:0.0:1788833152.570984:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10519:x1875727256436224:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 406us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.570991:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 97 00000100:00100000:3.0:1788833152.576964:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.577176:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256436480 00000100:00100000:0.0:1788833152.577214:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256436480 00000100:00100000:0.0:1788833152.577297:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 98 00000100:00100000:0.0:1788833152.577310:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:10519:x1875727256436480:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833152.577338:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833152.577364:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff0d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.577504:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff0e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.577520:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.577534:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833152.577546:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788833152.577712:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff0d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afaa expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.577734:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afaa expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.577744:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea1539c200) 00010000:00010000:0.0:1788833152.577748:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833152.577752:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ae00, rc 0) 00000100:00100000:0.0:1788833152.577846:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+37:10519:x1875727256436480:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 529us (887us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788833152.577856:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 98 00000100:00100000:2.0:1788833152.583930:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.587073:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256436608 00000100:00100000:0.0:1788833152.587096:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256436608 00000100:00100000:0.0:1788833152.587210:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:0.0:1788833152.587223:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+37:2359:x1875727256436608:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833152.587255:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833152.587810:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff0e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afaa expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.587837:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea1539c200) 00010000:00010000:0.0:1788833152.587844:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833152.587940:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+36:2359:x1875727256436608:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 720us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.587949:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:3.0:1788833152.596424:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.597692:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256436864 00000100:00100000:2.0:1788833152.597754:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256436864 00000100:00100000:2.0:1788833152.597970:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 99 00000100:00100000:2.0:1788833152.597983:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+36:10519:x1875727256436864:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833152.598016:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833152.598243:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff0ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afb1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.598378:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff0f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.598396:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.598410:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833152.598425:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788833152.598738:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff0ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afb1 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.598763:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff0f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afb1 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.598773:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea1539c200) 00010000:00010000:2.0:1788833152.598777:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788833152.598781:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036e00, rc 0) 00000100:00100000:2.0:1788833152.599154:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+38:10519:x1875727256436864:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 1171us (2743us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788833152.599164:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 99 00000100:00100000:3.0:1788833152.608132:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.608343:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256436992 00000100:00100000:2.0:1788833152.608376:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256436992 00000100:00100000:2.0:1788833152.608454:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:2.0:1788833152.608466:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256436992:12345-192.168.206.55@tcp:1:lfs.0 00010000:00010000:2.0:1788833152.608535:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.608560:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.608579:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833152.608584:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833152.608589:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.608648:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.608665:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 6 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.608682:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1875727265890560:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833152.608801:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833152.611338:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6655:1875727265890560:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833152.611374:0:6655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833152.613771:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833152.614157:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256437120 00000100:00100000:1.0:1788833152.614169:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256437120 00002000:00100000:1.0:1788833152.614450:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cea1fd44700 x1875727256437120/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:338/0 lens 504/0 e 0 to 0 dl 1788833163 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788833152.614463:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1fd44700 with x1875727256437120 ext(0->8) 00010000:00010000:1.0:1788833152.614641:0:6661:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 7 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.614664:0:6661:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 7 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833152.614674:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cea1fd44700 00000100:00100000:1.0:1788833152.614772:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:1.0:1788833152.614785:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256437120:12345-192.168.206.55@tcp:4:lfs.0 00000100:00100000:1.0:1788833152.615484:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2358:x1875727256437120:12345-192.168.206.55@tcp:4:lfs.0 Request processed in 685us (1709us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788833152.615502:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00002000:00100000:1.0:1788833152.615512:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cea1fd44700 x1875727256437120/t4294967302(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:338/0 lens 504/448 e 0 to 0 dl 1788833163 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788833152.615522:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1fd44700 with x1875727256437120 ext(0->8) 00010000:00010000:1.0:1788833152.615530:0:6661:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 9 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.615546:0:6661:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 9 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833152.615554:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cea1fd44700 00000100:00100000:3.0:1788833152.618921:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.619184:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256437248 00000100:00100000:0.0:1788833152.619202:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256437248 00010000:00010000:0.0:1788833152.619250:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 9 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.619300:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:0.0:1788833152.619312:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256437248:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833152.619329:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788833152.619352:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788833152.619355:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788833152 00002000:00010000:0.0:1788833152.619358:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788833152 00002000:00010000:0.0:1788833152.619360:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788833152 00010000:00010000:0.0:1788833152.619367:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 9 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.619403:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 9 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.619430:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ca8b563/0x8c08e876ed3ff0c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af9c expref: 9 pid: 8426 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.619451:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833152.619456:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833152.619462:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.619482:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.619519:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833152.619815:0:6655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619833:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619876:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619885:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619893:0:6655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619900:0:6655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833152.619904:0:6655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619912:0:6655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619928:0:6655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.619937:0:6655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ff103 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833152.620085:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40a7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256436992:12345-192.168.206.55@tcp:1:lfs.0 Request processed in 11620us (11965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833152.620094:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:0.0:1788833152.621054:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256437248:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 1710us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.621065:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:3.0:1788833152.625814:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.625981:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256437504 00000100:00100000:2.0:1788833152.625994:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256437504 00000100:00100000:2.0:1788833152.626097:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:2.0:1788833152.626109:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af0bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+38:10519:x1875727256437504:12345-192.168.206.55@tcp:35:lfs.0 00000004:00010000:2.0:1788833152.626197:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff0f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afb1 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833152.626512:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788833152.626561:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788833152.627408:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1788833152.627538:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.627558:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.627569:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.627609:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.627627:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 42 pid: 5813 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.627652:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265890688:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833152.627802:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833152.632494:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265890688:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833152.632531:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.632616:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.633207:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256437632 00000100:00100000:2.0:1788833152.633217:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256437632 00010000:00010000:2.0:1788833152.633266:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 43 pid: 5813 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.633359:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:2.0:1788833152.633370:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+43:2358:x1875727256437632:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833152.633389:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833152.633397:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 43 pid: 5813 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.633412:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 43 pid: 5813 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.633439:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff0af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af8e expref: 43 pid: 5813 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.633456:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea1539c200) 00010000:00010000:2.0:1788833152.633462:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.633472:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.633481:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.633534:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833152.633622:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+42:2358:x1875727256437632:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 252us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.633642:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 51 00010000:00010000:3.0:1788833152.635863:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.635884:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788833152.636086:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1788833152.636348:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788833152.636488:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265890816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788833152.636574:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833152.636645:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833152.636740:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265890816 00000100:00100000:2.0:1788833152.636749:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265890816 00000100:00100000:2.0:1788833152.636834:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833152.636845:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265890816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788833152.636941:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265890816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.636950:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788833152.637021:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833152.637425:0:5815:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788833152.637434:0:5815:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788833152.637458:0:5815:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea3fc46d80, transno 4294967301 00000100:00100000:3.0:1788833152.637522:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265890816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788833152.638228:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788833152.638316:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265890944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788833152.638370:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833152.638400:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23900 going to sleep for 11 seconds 00000100:00100000:2.0:1788833152.638845:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265890944 00000100:00100000:2.0:1788833152.638854:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265890944 00000100:00100000:2.0:1788833152.638918:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833152.638928:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265890944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788833152.639190:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1875727265890944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 262us (818us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788833152.639198:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788833152.639417:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265890944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788833152.639487:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788833152.639536:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.639548:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.639557:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.639564:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833152.639570:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.639578:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.639756:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea1539c200) 00010000:00010000:1.0:1788833152.639760:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788833152.639768:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.639776:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff10a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788833152.639995:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788833152.640174:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788833152.640187:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286706155679ns, next at 287706152434ns, rc = 0 00000001:00080000:1.0:1788833152.640195:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788833152.640235:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea1539c200) 00010000:00010000:1.0:1788833152.640238:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788833152.640246:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff0f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afb1 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833152.640369:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af0bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+45:10519:x1875727256437504:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 14262us (14568us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788833152.640378:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 26 00000020:00080000:1.0:1788833152.640383:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788833152.642223:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833152.642667:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256437760 00000100:00100000:3.0:1788833152.642679:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256437760 00000100:00100000:3.0:1788833152.642736:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:3.0:1788833152.642763:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+45:10519:x1875727256437760:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833152.642787:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833152.642809:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afb8 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.642862:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afb8 expref: 46 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.642875:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afb8 expref: 46 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.642902:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:3.0:1788833152.642905:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788833152.642908:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd200, rc 0) 00000100:00100000:3.0:1788833152.642966:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+46:10519:x1875727256437760:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 207us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833152.642972:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:3.0:1788833152.654135:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833152.654543:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256438016 00000100:00100000:1.0:1788833152.654561:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256438016 00000100:00100000:1.0:1788833152.654655:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:1.0:1788833152.654668:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+46:10519:x1875727256438016:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:1.0:1788833152.655025:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+47:10519:x1875727256438016:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 358us (899us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788833152.655084:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:1.0:1788833152.716871:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833152.716976:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833152.717026:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.717153:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256438144 00000100:00100000:2.0:1788833152.717166:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256438144 00000100:00100000:3.0:1788833152.717245:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256438272 00000100:00100000:3.0:1788833152.717251:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256438272 00000100:00100000:3.0:1788833152.717311:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 72 00000100:00100000:3.0:1788833152.717323:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2359:x1875727256438272:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833152.717356:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 284 00000100:00100000:2.0:1788833152.717364:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256438144:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833152.717426:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2359:x1875727256438272:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 105us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833152.717435:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 72 00000100:00100000:2.0:1788833152.717468:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256438144:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 105us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.717475:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 284 00000100:00100000:0.0:1788833152.717767:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256438400 00000100:00100000:0.0:1788833152.717773:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256438400 00000100:00100000:0.0:1788833152.717844:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00100000:0.0:1788833152.717859:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256438400:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833152.717908:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256438400:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 51us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.717926:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00080000:1.0:1788833152.717939:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833152.759086:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.760361:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256438528 00000100:00100000:2.0:1788833152.760378:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256438528 00000100:00100000:2.0:1788833152.760463:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 101 00000100:00100000:2.0:1788833152.760474:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+47:10529:x1875727256438528:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:2.0:1788833152.760569:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760591:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760604:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760620:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760640:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760648:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760764:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760773:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760780:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833152.760829:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760860:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760867:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760874:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760881:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.760886:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760894:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760907:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833152.760910:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.760915:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760922:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760937:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760943:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760950:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760959:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.760962:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760968:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760975:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea1539c000) 00010000:00010000:2.0:1788833152.760978:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.760980:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.760986:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff11f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.761000:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.761007:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.761013:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.761018:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.761021:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.761026:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.761112:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833152.761115:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.761118:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.761125:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff126 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.761467:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+47:10529:x1875727256438528:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 990us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.761476:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 101 00000100:00100000:3.0:1788833152.799823:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.800166:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256438784 00000100:00100000:0.0:1788833152.800180:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256438784 00000100:00100000:0.0:1788833152.800323:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 102 00000100:00100000:0.0:1788833152.800342:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+47:10532:x1875727256438784:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833152.800369:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833152.800395:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff12d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afbf expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.800588:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.800606:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.800641:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.800659:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.800668:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.800675:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.801218:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.801794:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.801805:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833152.801819:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788833152.801949:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.801958:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.801965:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.801971:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925bc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833152.801977:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.801985:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802000:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833152.802004:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833152.802009:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802015:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802732:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802759:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802765:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802771:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833152.802775:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802782:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802794:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea08db1100) 00010000:00010000:0.0:1788833152.802798:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833152.802801:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802807:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff13b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802877:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff12d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 50 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802894:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 49 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.802904:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833152.802907:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833152.802916:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b200, rc 0) 00000100:00100000:0.0:1788833152.803011:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+49:10532:x1875727256438784:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 2677us (3200us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788833152.803021:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 102 00000100:00100000:1.0:1788833152.809456:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.809600:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256438912 00000100:00100000:2.0:1788833152.809611:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256438912 00000100:00100000:2.0:1788833152.809679:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 103 00000100:00100000:2.0:1788833152.809688:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+49:10532:x1875727256438912:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:2.0:1788833152.809753:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809771:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809781:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809804:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809811:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809834:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809841:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.809845:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809853:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809865:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833152.809868:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833152.809872:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.809878:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833152.810169:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+49:10532:x1875727256438912:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 474us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833152.810177:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 103 00000100:00100000:1.0:1788833152.812084:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833152.813976:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256439168 00000100:00100000:3.0:1788833152.814004:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256439168 00000100:00100000:3.0:1788833152.814506:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:3.0:1788833152.814518:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+49:10532:x1875727256439168:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833152.814766:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+50:10532:x1875727256439168:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 250us (2688us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788833152.814775:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:3.0:1788833152.903168:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.903324:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256439424 00000100:00100000:0.0:1788833152.903336:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256439424 00000100:00100000:0.0:1788833152.903394:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 104 00000100:00100000:0.0:1788833152.903404:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+50:10542:x1875727256439424:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833152.903662:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833152.903666:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788833152.903691:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff0d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afa3 expref: 50 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.903799:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833152.903805:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833152.903821:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff157 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afc6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.903909:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.903921:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 50 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.903930:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.903959:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 50 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.903990:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 50 pid: 8616 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.904002:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265891072:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833152.904194:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833152.908050:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265891072:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833152.908080:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833152.909735:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.909946:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256439552 00000100:00100000:0.0:1788833152.909955:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256439552 00010000:00010000:0.0:1788833152.910147:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 51 pid: 8616 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.910188:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:0.0:1788833152.910198:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+51:2357:x1875727256439552:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833152.910212:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833152.910219:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 51 pid: 8616 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.910231:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 51 pid: 8616 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.910252:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afbf expref: 51 pid: 8616 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.910329:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833152.910334:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.910344:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.910351:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.910376:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833152.910427:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.910435:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833152.910452:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788833152.910593:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff157 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833152.910609:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.910609:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+51:2357:x1875727256439552:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 412us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.910616:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 52 00010000:00010000:3.0:1788833152.910617:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:3.0:1788833152.910620:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788833152.910623:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b400, rc 0) 00000100:00100000:3.0:1788833152.910656:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+50:10542:x1875727256439424:12345-192.168.206.55@tcp:101:bash.0 Request processed in 7254us (7496us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788833152.910662:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 104 00000100:00100000:2.0:1788833152.913249:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.913308:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256439808 00000100:00100000:0.0:1788833152.913316:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256439808 00000100:00100000:0.0:1788833152.913364:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 105 00000100:00100000:0.0:1788833152.913374:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+50:10542:x1875727256439808:12345-192.168.206.55@tcp:36:bash.0 00010000:00010000:0.0:1788833152.913623:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.913649:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.913659:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833152.913723:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:0.0:1788833152.913750:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9df9493 reply state 00000000953ffce2 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.913771:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833152.914095:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+53:10542:x1875727256439808:12345-192.168.206.55@tcp:36:bash.0 Request processed in 721us (851us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788833152.914102:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 105 00000020:00080000:0.0:1788833152.914106:0:8616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788833152.916896:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00010000:00010000:2.0:1788833152.917007:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.917018:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.917026:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.917066:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ba00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833152.917071:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.917078:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.917093:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833152.917097:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833152.917101:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833152.917107:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff16c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.917261:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256439936 00000100:00100000:0.0:1788833152.917271:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256439936 00000100:00100000:0.0:1788833152.917319:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 106 00000100:00100000:0.0:1788833152.917329:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+52:10542:x1875727256439936:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833152.917350:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833152.917365:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afcd expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.917460:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.917481:0:11926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.917489:0:11926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.917522:0:11926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.917534:0:11926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 53 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.917560:0:11926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265891200:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833152.917955:0:11926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833152.920998:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833152.921106:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256440064 00000100:00100000:1.0:1788833152.921115:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256440064 00010000:00010000:1.0:1788833152.921151:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 54 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833152.921191:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:1.0:1788833152.921200:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+54:2357:x1875727256440064:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833152.921214:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833152.921219:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 54 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.921232:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 54 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.921251:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833152.921256:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.921265:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.921285:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.921303:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833152.921346:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+54:2357:x1875727256440064:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833152.921353:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 53 00010000:00010000:0.0:1788833152.921456:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff15e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afc6 expref: 53 pid: 5812 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833152.921485:0:11926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265891200:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833152.921508:0:11926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.921516:0:11926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.921522:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833152.921564:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788833152.921568:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833152.921598:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.921639:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 53 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.921654:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 52 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.921662:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833152.921671:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833152.921674:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ac00, rc 0) 00000100:00100000:0.0:1788833152.921701:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+52:10542:x1875727256439936:12345-192.168.206.55@tcp:101:bash.0 Request processed in 4374us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.921709:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 106 00000100:00100000:1.0:1788833152.929879:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833152.930200:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256440320 00000100:00100000:2.0:1788833152.930210:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256440320 00000100:00100000:2.0:1788833152.930337:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:2.0:1788833152.930348:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+52:10542:x1875727256440320:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:2.0:1788833152.930590:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+53:10542:x1875727256440320:12345-192.168.206.55@tcp:35:bash.0 Request processed in 243us (721us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788833152.930597:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:3.0:1788833152.988740:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833152.988841:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256440448 00000100:00100000:0.0:1788833152.988851:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256440448 00000100:00100000:0.0:1788833152.988934:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 107 00000100:00100000:0.0:1788833152.988944:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+53:10548:x1875727256440448:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833152.988967:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833152.988986:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.989076:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.989090:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.989102:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833152.989132:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788833152.989135:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833152.989150:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.989173:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afd4 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.989207:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afd4 expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833152.989215:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:0.0:1788833152.989218:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833152.989233:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b400, rc 0) 00000100:00100000:0.0:1788833152.989286:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:10548:x1875727256440448:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 343us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833152.989293:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 107 00000100:00100000:0.0:1788833152.993852:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833152.994300:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256440576 00000100:00100000:1.0:1788833152.994309:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256440576 00000100:00100000:1.0:1788833152.994426:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 108 00000100:00100000:1.0:1788833152.994436:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+54:10548:x1875727256440576:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833152.994457:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833152.994490:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff18f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afdb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994548:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994562:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994571:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994585:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994591:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994609:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994704:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff1a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994713:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994720:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833152.994754:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788833152.994758:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833152.994774:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994786:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994793:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994800:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994806:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994813:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fe00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833152.994817:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994832:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994844:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:1.0:1788833152.994847:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833152.994851:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994857:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994871:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994877:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994882:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994886:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fa00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833152.994889:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994894:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994900:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea0884e400) 00010000:00010000:1.0:1788833152.994902:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833152.994904:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994919:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff19d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994947:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff18f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afdb expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994959:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afdb expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833152.994966:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833152.994968:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833152.994970:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f800, rc 0) 00000100:00100000:1.0:1788833152.995066:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10548:x1875727256440576:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 596us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833152.995073:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 108 00000100:00100000:1.0:1788833152.999896:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833153.000078:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256440704 00000100:00100000:2.0:1788833153.000088:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256440704 00000100:00100000:2.0:1788833153.000143:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:2.0:1788833153.000152:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+55:2359:x1875727256440704:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833153.000165:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833153.000198:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff1a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afdb expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.000216:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833153.000221:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833153.000378:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:2359:x1875727256440704:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 224us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833153.000388:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1788833153.004531:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833153.004801:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256440960 00000100:00100000:0.0:1788833153.004810:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256440960 00000100:00100000:0.0:1788833153.004877:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 109 00000100:00100000:0.0:1788833153.004887:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+54:10548:x1875727256440960:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833153.004907:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833153.004925:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff1ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afe2 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.005015:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.005062:0:11926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 55 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.005073:0:11926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.005123:0:11926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 55 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.005136:0:11926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 55 pid: 11926 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833153.005149:0:11926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265891328:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833153.005233:0:11926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788833153.005302:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788833153.005787:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833153.008055:0:11926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265891328:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833153.008084:0:11926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833153.010643:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833153.010729:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256441088 00000100:00100000:1.0:1788833153.010738:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256441088 00010000:00010000:1.0:1788833153.010770:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 56 pid: 11926 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833153.010805:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:1.0:1788833153.010814:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0c66d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+56:2357:x1875727256441088:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833153.010827:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833153.010833:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 56 pid: 11926 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.010857:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 56 pid: 11926 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.010878:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff17a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afcd expref: 56 pid: 11926 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.010892:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833153.010897:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.010906:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.010913:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.010939:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833153.010989:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0c66d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+55:2357:x1875727256441088:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 176us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833153.010997:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 54 00010000:00010000:2.0:1788833153.011916:0:11926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.011928:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833153.011946:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788833153.012125:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff1ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 56 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.012143:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 55 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.012151:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833153.012154:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788833153.012157:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925be00, rc 0) 00000100:00100000:2.0:1788833153.012250:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10548:x1875727256440960:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 7365us (7728us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788833153.012274:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 109 00000100:00100000:3.0:1788833153.023383:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833153.023610:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256441344 00000100:00100000:0.0:1788833153.023620:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256441344 00000100:00100000:0.0:1788833153.023756:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:0.0:1788833153.023768:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10548:x1875727256441344:12345-192.168.206.55@tcp:103:lfs.0 00010000:00010000:0.0:1788833153.023784:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833153.024867:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afb8 expref: 55 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.024901:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833153.024906:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833153.024975:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+54:10548:x1875727256441344:12345-192.168.206.55@tcp:103:lfs.0 Request processed in 1208us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833153.024984:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:3.0:1788833153.028133:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833153.028335:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256441472 00000100:00100000:1.0:1788833153.028345:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256441472 00000100:00100000:1.0:1788833153.028400:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 110 00000100:00100000:1.0:1788833153.028410:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:10548:x1875727256441472:12345-192.168.206.55@tcp:58:lfs.0 00010000:00010000:1.0:1788833153.028500:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.028516:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833153.028541:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833153.028788:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788833153.028962:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:10548:x1875727256441472:12345-192.168.206.55@tcp:58:lfs.0 Request processed in 551us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833153.028970:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 110 00000100:00100000:1.0:1788833153.033318:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833153.033413:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256441600 00000100:00100000:2.0:1788833153.033421:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256441600 00000100:00100000:2.0:1788833153.033512:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 111 00000100:00100000:2.0:1788833153.033522:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+54:10548:x1875727256441600:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833153.033539:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833153.033558:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72afe9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.033634:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.033646:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.033664:0:5811:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.033683:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.033697:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833153.033700:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833153.033704:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.033712:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037c00, rc 0) 00000100:00100000:2.0:1788833153.033779:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10548:x1875727256441600:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 258us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833153.033786:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 111 00000100:00100000:2.0:1788833153.645410:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265891712:0@lo:400:kworker.0 00000100:00100000:2.0:1788833153.645573:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833153.645647:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833153.645653:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265891840:0@lo:400:kworker.0 00000100:00100000:2.0:1788833153.645680:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833153.645763:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265891840 00000100:00100000:1.0:1788833153.645771:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265891840 00000100:00100000:1.0:1788833153.645828:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788833153.645837:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1875727265891840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833153.645891:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3276:x1875727265891840:12345-0@lo:400:kworker.0 Request processed in 55us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833153.645898:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788833153.645936:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265891840:0@lo:400:kworker.0 00000100:00100000:1.0:1788833153.645960:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265891712 00000100:00100000:1.0:1788833153.645963:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265891712 00000100:00100000:1.0:1788833153.645996:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788833153.646003:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265891712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833153.646075:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265891712:12345-0@lo:400:kworker.0 Request processed in 72us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833153.646081:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788833153.646107:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265891712:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.646241:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265891456:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.646276:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833153.646309:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265891968:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.646332:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833153.646364:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788833153.646371:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265891584:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.646393:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833153.646408:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265892096:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.646427:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833153.646773:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265892096 00000100:00100000:3.0:1788833153.646779:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265892096 00000100:00100000:3.0:1788833153.646807:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788833153.646813:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875727265892096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833153.646853:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875727265892096:12345-0@lo:400:kworker.0 Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833153.646859:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788833153.646880:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265891968 00000100:00100000:3.0:1788833153.646883:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265891968 00000100:00100000:3.0:1788833153.646903:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265891584 00000100:00100000:3.0:1788833153.646906:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265891584 00000100:00100000:3.0:1788833153.646922:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788833153.646928:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265891968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833153.646958:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265891968:12345-0@lo:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833153.646964:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788833153.646975:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788833153.646980:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265891584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833153.647004:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265891584:12345-0@lo:400:kworker.0 Request processed in 25us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833153.647009:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788833153.647123:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788833153.647128:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833153.647181:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265891456 00000100:00100000:1.0:1788833153.647191:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265891456 00000100:00100000:1.0:1788833153.647221:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788833153.647227:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265891456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833153.647256:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265891456:12345-0@lo:400:kworker.0 Request processed in 29us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833153.647262:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788833153.648250:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265891584:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.648263:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265892096:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.648271:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265891456:0@lo:400:kworker.0 00000100:00100000:0.0:1788833153.648280:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265891968:0@lo:400:kworker.0 00000040:00080000:3.0:1788833153.901372:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833153.901381:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833153.901435:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788833153.901442:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788833153.901580:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265892224:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788833153.901708:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23600 going to sleep for 11 seconds 00000100:00100000:1.0:1788833153.907858:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833153.907978:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265892224:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788833153.908207:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256441728 00000100:00100000:2.0:1788833153.908215:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256441728 00000100:00100000:2.0:1788833153.908262:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 112 00000100:00100000:2.0:1788833153.908271:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10549:x1875727256441728:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788833153.908299:0:11926:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788833153.908424:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10549:x1875727256441728:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 152us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833153.908433:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 112 00000100:00100000:3.0:1788833153.914522:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833153.914720:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256441856 00000100:00100000:2.0:1788833153.914730:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256441856 00000100:00100000:2.0:1788833153.914794:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 113 00000100:00100000:2.0:1788833153.914806:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10549:x1875727256441856:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788833153.914881:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.914897:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.914932:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.914984:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.914992:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.914999:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915021:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915058:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915066:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833153.915104:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788833153.915108:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833153.915121:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915132:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915138:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915157:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915164:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833153.915169:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915177:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915190:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:2.0:1788833153.915194:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833153.915197:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915203:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff1ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915216:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915222:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915227:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915231:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833153.915234:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915249:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915258:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9cea1539c000) 00010000:00010000:2.0:1788833153.915260:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833153.915263:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915269:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915283:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915289:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915295:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915300:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833153.915302:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915308:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915315:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833153.915317:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833153.915320:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.915335:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833153.915538:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10549:x1875727256441856:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 Request processed in 732us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833153.915546:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 113 00000100:00100000:0.0:1788833153.925846:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833153.925941:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256442112 00000100:00100000:3.0:1788833153.925951:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256442112 00000100:00100000:3.0:1788833153.926010:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 114 00000100:00100000:3.0:1788833153.926021:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+55:10549:x1875727256442112:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833153.926074:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833153.926096:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff1e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aff0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926190:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926206:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926217:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833153.926228:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788833153.926836:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926864:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926871:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926877:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833153.926881:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926889:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926902:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:3.0:1788833153.926905:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788833153.926909:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926915:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff1ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926960:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff1e3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aff0 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926971:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:3.0:1788833153.926973:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833153.926977:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff1e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aff0 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.926986:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dca00, rc 0) 00000100:00100000:3.0:1788833153.927089:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+56:10549:x1875727256442112:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 1069us (1250us total) trans 4294967398 rc 301/301 00000100:00100000:3.0:1788833153.927097:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 114 00000100:00100000:1.0:1788833153.938486:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833153.938581:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256442240 00000100:00100000:2.0:1788833153.938591:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256442240 00000100:00100000:2.0:1788833153.938661:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:2.0:1788833153.938671:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+56:10549:x1875727256442240:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788833153.938725:0:11926:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788833153.938831:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+56:10549:x1875727256442240:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 162us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833153.938839:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:0.0:1788833153.952214:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833153.952653:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256442496 00000100:00100000:2.0:1788833153.952663:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256442496 00000100:00100000:2.0:1788833153.952716:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 116 00000100:00100000:2.0:1788833153.952725:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+56:10549:x1875727256442496:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833153.952743:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833153.952746:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788833153.952771:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afd4 expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.952789:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:2.0:1788833153.952793:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833153.952806:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72aff7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788833153.953751:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788833153.955004:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.955023:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.955051:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.955121:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff1f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aff7 expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.955141:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aff7 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.955149:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea1539c000) 00010000:00010000:2.0:1788833153.955152:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833153.955155:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037000, rc 0) 00000100:00100000:2.0:1788833153.955288:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+57:10549:x1875727256442496:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 2563us (3082us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788833153.955297:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 116 00000100:00100000:0.0:1788833153.972929:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833153.973210:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256442752 00000100:00100000:3.0:1788833153.973219:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256442752 00000100:00100000:3.0:1788833153.973271:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 117 00000100:00100000:3.0:1788833153.973280:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+57:10549:x1875727256442752:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788833153.973336:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833153.973361:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff1ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72aff7 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973379:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea1539c000) 00010000:00010000:3.0:1788833153.973389:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833153.973410:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973421:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973431:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973499:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973507:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973513:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973587:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973594:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973600:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973606:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dca00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833153.973610:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973618:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973635:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:3.0:1788833153.973638:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833153.973642:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973648:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff20d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973659:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973664:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973669:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973680:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833153.973683:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973690:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973698:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x51bd2b73 (ffff9cea32de4e00) 00010000:00010000:3.0:1788833153.973700:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833153.973703:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.973708:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff214 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x51bd2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833153.973773:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+56:10549:x1875727256442752:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 494us (853us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788833153.973780:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 117 00000100:00100000:1.0:1788833153.978674:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833153.978789:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256442880 00000100:00100000:3.0:1788833153.978799:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256442880 00000100:00100000:3.0:1788833153.978861:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 118 00000100:00100000:3.0:1788833153.978871:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+56:10549:x1875727256442880:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833153.978890:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833153.978912:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff21b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72affe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.978947:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.978979:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.978991:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.979127:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff21b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.979148:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833153.979157:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:3.0:1788833153.979161:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788833153.979164:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833153.979218:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+57:10549:x1875727256442880:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 349us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833153.979226:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 118 00000100:00100000:0.0:1788833153.989938:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833153.990087:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256443136 00000100:00100000:2.0:1788833153.990097:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256443136 00000100:00100000:2.0:1788833153.990148:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 119 00000100:00100000:2.0:1788833153.990157:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+57:10549:x1875727256443136:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788833153.990235:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.990267:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833153.990279:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833153.990601:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788833153.990631:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288056599381ns, next at 289056589002ns, rc = 0 00000004:00010000:0.0:1788833153.990714:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a2921a8 reply state 00000000123965d5 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833153.990724:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833153.990819:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+59:10549:x1875727256443136:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 662us (889us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788833153.990826:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 119 00010000:00010000:0.0:1788833153.994251:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.994269:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.994290:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.994297:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833153.994302:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.994311:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.994327:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:0.0:1788833153.994331:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788833153.994335:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833153.994341:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff229 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.001424:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833154.002666:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256443264 00000100:00100000:2.0:1788833154.002677:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256443264 00000100:00100000:2.0:1788833154.002741:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:2.0:1788833154.002750:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+58:10549:x1875727256443264:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833154.002771:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833154.002791:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b005 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.002847:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 59 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.002862:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 59 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.002881:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:2.0:1788833154.002885:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833154.002888:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037600, rc 0) 00000100:00100000:2.0:1788833154.002947:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+59:10549:x1875727256443264:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 197us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833154.002954:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:1.0:1788833154.011683:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833154.012015:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256443392 00000100:00100000:2.0:1788833154.012080:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256443392 00000100:00100000:2.0:1788833154.012153:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:2.0:1788833154.012165:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2358:x1875727256443392:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788833154.012421:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2358:x1875727256443392:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 258us (747us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788833154.012429:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00080000:1.0:1788833154.016682:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833154.023921:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.024081:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256443648 00000100:00100000:3.0:1788833154.024091:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256443648 00000100:00100000:3.0:1788833154.024148:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:3.0:1788833154.024158:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+59:10549:x1875727256443648:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788833154.024378:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+60:10549:x1875727256443648:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 221us (467us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788833154.024387:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:0.0:1788833154.028313:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.029888:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256443904 00000100:00100000:3.0:1788833154.029915:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256443904 00000100:00100000:3.0:1788833154.029985:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 121 00000100:00100000:3.0:1788833154.029996:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+60:10549:x1875727256443904:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788833154.030144:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+60:10549:x1875727256443904:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 150us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833154.030152:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 121 00010000:00010000:0.0:1788833154.030301:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833154.033825:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833154.034329:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256444032 00000100:00100000:0.0:1788833154.034338:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256444032 00000100:00100000:0.0:1788833154.034399:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 122 00000100:00100000:0.0:1788833154.034409:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+60:10549:x1875727256444032:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833154.034426:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833154.034447:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff237 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b00c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.034533:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff23e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.034547:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.034557:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833154.034590:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833154.034606:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.034648:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff237 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b00c expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.034664:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b00c expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.034673:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:0.0:1788833154.034676:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788833154.034679:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925aa00, rc 0) 00000100:00100000:0.0:1788833154.034744:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+61:10549:x1875727256444032:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 336us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833154.034752:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 122 00000100:00100000:2.0:1788833154.038582:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.038871:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256444160 00000100:00100000:3.0:1788833154.038881:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256444160 00000100:00100000:3.0:1788833154.038936:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:3.0:1788833154.038951:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256444160:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833154.038966:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833154.038984:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b013 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833154.039009:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6d81, blocks: 0x1 00010000:00010000:3.0:1788833154.039027:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=288s v=(0 0) 00010000:00010000:3.0:1788833154.039087:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833154.039097:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 10 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.039115:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 10 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.039129:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd200, rc 0) 00000100:00100000:3.0:1788833154.039179:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+10:2357:x1875727256444160:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 235us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833154.039204:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:1.0:1788833154.043593:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833154.043955:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256444416 00000100:00100000:2.0:1788833154.043965:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256444416 00000100:00100000:2.0:1788833154.044072:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 123 00000100:00100000:2.0:1788833154.044084:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+61:10549:x1875727256444416:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833154.044194:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+61:10549:x1875727256444416:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 112us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833154.044202:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 123 00000100:00100000:1.0:1788833154.050537:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833154.050639:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256444544 00000100:00100000:2.0:1788833154.050648:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256444544 00000100:00100000:2.0:1788833154.050734:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:2.0:1788833154.050745:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+10:10549:x1875727256444544:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833154.050763:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833154.050779:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b01a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.050808:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.050817:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833154.050833:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833154.050839:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.050881:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.050894:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 11 pid: 8426 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833154.050907:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1875727265892352:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833154.050990:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833154.055259:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6656:1875727265892352:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833154.055295:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.055318:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037400, rc 0) 00000100:00100000:2.0:1788833154.055383:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+11:10549:x1875727256444544:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 4639us (4854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833154.055392:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:1.0:1788833154.057156:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833154.057249:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256444672 00000100:00100000:0.0:1788833154.057257:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256444672 00010000:00010000:0.0:1788833154.057293:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 11 pid: 8426 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.057352:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:0.0:1788833154.057362:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+11:2357:x1875727256444672:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833154.057380:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833154.057403:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 11 pid: 8426 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.057419:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 11 pid: 8426 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.057444:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a533e8a3/0x8c08e876ed3ff245 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b013 expref: 11 pid: 8426 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.057461:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833154.057466:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833154.057485:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 10 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.057497:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 10 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.057540:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 10 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.057557:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1875727265892480:192.168.206.55@tcp:105: 00000100:00100000:0.0:1788833154.057659:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788833154.066943:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1875727265892480:192.168.206.55@tcp:105: 00010000:00010000:0.0:1788833154.066971:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833154.067795:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+10:2357:x1875727256444672:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 9669us (9881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833154.067810:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:1.0:1788833154.071321:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.071414:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256444800 00000100:00100000:3.0:1788833154.071424:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256444800 00002000:00100000:3.0:1788833154.071479:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cea1f42ea00 x1875727256444800/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:340/0 lens 504/0 e 0 to 0 dl 1788833165 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833154.071490:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1f42ea00 with x1875727256444800 ext(0->12) 00002000:00010000:3.0:1788833154.071496:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea1f42ea00 00000100:00100000:3.0:1788833154.071529:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:3.0:1788833154.071539:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+10:2357:x1875727256444800:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788833154.071993:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+12:2357:x1875727256444800:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 Request processed in 453us (679us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788833154.072001:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00002000:00100000:3.0:1788833154.072008:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cea1f42ea00 x1875727256444800/t4294967308(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:340/0 lens 504/448 e 0 to 0 dl 1788833165 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833154.072016:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1f42ea00 with x1875727256444800 ext(0->12) 00002000:00010000:3.0:1788833154.072019:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea1f42ea00 00000100:00100000:1.0:1788833154.075752:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.076223:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256444928 00000100:00100000:3.0:1788833154.076242:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256444928 00000100:00100000:3.0:1788833154.076302:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 124 00000100:00100000:3.0:1788833154.076311:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+61:10549:x1875727256444928:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788833154.126165:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788833154.126176:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788833154.126200:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788833154.126345:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265892736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788833154.126425:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833154.126488:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788833154.126495:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265892608:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788833154.126518:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833154.126552:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265892736 00000100:00100000:0.0:1788833154.126560:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265892736 00000100:00100000:0.0:1788833154.126632:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265892608 00000100:00100000:0.0:1788833154.126636:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265892608 00000100:00100000:0.0:1788833154.126657:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788833154.126664:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265892736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788833154.126810:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788833154.126815:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788833153 00002000:00010000:0.0:1788833154.126818:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788833154.126820:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788833153 -> 1788833153 00002000:00010000:0.0:1788833154.126823:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788833154.126862:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3277:x1875727265892736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (437us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788833154.126886:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788833154.126903:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788833154.126911:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265892608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788833154.126925:0:6655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788833154.126942:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.126962:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.126970:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788833154.126975:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833154.126979:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.127006:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.127019:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 11 pid: 6654 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.127050:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265892864:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833154.127111:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f99e540 going to sleep for 11 seconds 00000004:00080000:0.0:1788833154.127147:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea40fb1880/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788833154.127152:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265892736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788833154.127805:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+52:10549:x1875727256444928:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 Request processed in 51491us (52058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833154.127814:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 124 00000004:00080000:0.0:1788833154.128891:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788833154.130288:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cea40f23180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788833154.130299:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f993a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cea40f23b40 00000020:00080000:0.0:1788833154.130302:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f993c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea08877c00 00000020:00080000:1.0:1788833154.130347:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:1.0:1788833154.130571:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:0.0:1788833154.130733:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000020:00080000:0.0:1788833154.130751:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cea1f27db40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788833154.130755:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea094d1300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cea1f27d480 00000020:00080000:0.0:1788833154.130758:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea094d1b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea1fd4c800 00000100:00100000:3.0:1788833154.131170:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788833154.131191:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265892992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788833154.131251:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788833154.131486:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788833154.131529:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788833154.131589:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265892992 00000100:00100000:0.0:1788833154.131597:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265892992 00000100:00100000:0.0:1788833154.131706:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788833154.131715:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1875727265892992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788833154.131740:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788833154.131774:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f6d80, atime: 0x6a9f6d80, ctime: 0x6a9f6d80, blocks: 0x1 00010000:00010000:0.0:1788833154.131781:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.131797:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=288s v=(0 0) 00010000:00010000:0.0:1788833154.131801:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833154.131808:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.131822:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.131844:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.131852:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.131869:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833154.131882:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833154.131888:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.131895:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833154.131899:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.131908:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.131924:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.131931:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945fcbf6/0x8c08e876ed3ff25a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.131946:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833154.131948:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833154.131949:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833154.132366:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265892992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 650us (1111us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788833154.132373:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788833154.132513:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833154.132760:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265892864:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833154.132785:0:6655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788833154.133215:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea3fb2c000/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788833154.133223:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265892992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788833154.133507:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833154.133548:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833154.133726:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256445056 00000100:00100000:2.0:1788833154.133734:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256445056 00010000:00010000:2.0:1788833154.133765:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 12 pid: 6654 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833154.133802:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 56 00000100:00100000:2.0:1788833154.133811:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+12:2357:x1875727256445056:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833154.133824:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788833154.133825:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256445184 00000100:00100000:3.0:1788833154.133829:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256445184 00010000:00010000:2.0:1788833154.133829:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 12 pid: 6654 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.133842:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 13 pid: 6654 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.133871:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b54c9b47/0x8c08e876ed3ff015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af79 expref: 13 pid: 6654 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833154.133902:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:3.0:1788833154.133911:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+12:2357:x1875727256445184:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788833154.133945:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833154.133950:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833154.133955:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.133964:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.134013:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833154.134085:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+12:2357:x1875727256445056:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 274us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833154.134092:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 56 00010000:00010000:3.0:1788833154.134318:0:6655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134334:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134344:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134352:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134367:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833154.134596:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833154.134602:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134832:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833154.134836:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134846:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134860:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134868:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fbe270/0x8c08e876ed3ff253 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.134900:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833154.134902:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833154.134904:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833154.138828:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3277:x1875727265892608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11910us (12300us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788833154.138841:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788833154.138893:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea40fb1180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788833154.138900:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265892608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788833154.157268:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265893120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833154.157338:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833154.157440:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265893120 00000100:00100000:1.0:1788833154.157447:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265893120 00000100:00100000:1.0:1788833154.157498:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788833154.157507:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3279:x1875727265893120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833154.157536:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833154.157591:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3279:x1875727265893120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833154.157598:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788833154.157817:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265893120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833154.158282:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3957b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265893248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833154.158316:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833154.158397:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265893248 00000100:00100000:3.0:1788833154.158402:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265893248 00000100:00100000:3.0:1788833154.158436:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788833154.158443:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265893248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788833154.158467:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833154.158505:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265893248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833154.158511:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788833154.158542:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3957b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265893248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833154.263082:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+11:2357:x1875727256445184:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 Request processed in 129162us (129565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833154.263096:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 43 00000001:00080000:2.0:1788833154.263187:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788833154.263201:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1788833154.263208:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788833154.263214:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788833154.267083:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.267206:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256445440 00000100:00100000:3.0:1788833154.267217:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256445440 00000100:00100000:3.0:1788833154.267277:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 125 00000100:00100000:3.0:1788833154.267287:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+15:10549:x1875727256445440:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788833154.267339:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833154.267363:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff23e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b00c expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.267396:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:3.0:1788833154.267401:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833154.267431:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.267444:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.267453:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833154.267695:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035c5d2b3 reply state 000000008913b9ab transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833154.267705:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788833154.267812:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+16:10549:x1875727256445440:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 525us (738us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788833154.267819:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 125 00000100:00100000:3.0:1788833154.271995:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00010000:00010000:2.0:1788833154.272284:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.272296:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.272303:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.272310:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833154.272314:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.272322:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.272339:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:2.0:1788833154.272343:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833154.272361:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.272367:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff261 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.272442:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256445568 00000100:00100000:0.0:1788833154.272451:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256445568 00000100:00100000:0.0:1788833154.272505:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:0.0:1788833154.272515:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256445568:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788833154.272713:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788833154.272716:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788833153 -> 1788833152 00002000:00010000:0.0:1788833154.272719:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788833152 00002000:00010000:0.0:1788833154.272721:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788833153 -> 1788833152 00002000:00010000:0.0:1788833154.272724:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788833154.272793:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256445568:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 278us (806us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788833154.272801:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:0.0:1788833154.283916:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.284137:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256445824 00000100:00100000:3.0:1788833154.284148:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256445824 00000100:00100000:3.0:1788833154.284206:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 126 00000100:00100000:3.0:1788833154.284218:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+15:10549:x1875727256445824:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788833154.284287:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.284304:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.284332:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.284363:0:8616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.284377:0:8616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 15 pid: 5812 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833154.284390:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265893376:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833154.284499:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23600 going to sleep for 11 seconds 00000100:00100000:1.0:1788833154.297092:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.297366:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265893376:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833154.297398:0:8616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833154.302450:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256445952 00000100:00100000:2.0:1788833154.302465:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256445952 00010000:00010000:3.0:1788833154.302605:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 16 pid: 5812 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833154.302728:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:3.0:1788833154.302739:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+16:2357:x1875727256445952:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833154.302756:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833154.302764:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 16 pid: 5812 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.302776:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 16 pid: 5812 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.302812:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72affe expref: 16 pid: 5812 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.302831:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:3.0:1788833154.302836:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.302844:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.302852:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.302888:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833154.302950:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+15:2357:x1875727256445952:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 213us (5868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833154.302958:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 57 00010000:00010000:1.0:1788833154.303020:0:8616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303045:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303072:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303080:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303086:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303092:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dca00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833154.303097:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303104:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303113:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:1.0:1788833154.303137:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788833154.303141:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.303148:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833154.303193:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+14:10549:x1875727256445824:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 Request processed in 18977us (19286us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788833154.303202:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 126 00000100:00100000:1.0:1788833154.307758:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.307829:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256446080 00000100:00100000:3.0:1788833154.307839:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256446080 00000100:00100000:3.0:1788833154.307884:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:3.0:1788833154.307894:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256446080:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788833154.307937:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.307956:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.307985:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833154.307990:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833154.307994:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.308061:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.308076:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 7 pid: 6656 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833154.308090:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265893504:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833154.308170:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23600 going to sleep for 11 seconds 00000100:00100000:2.0:1788833154.316129:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.318345:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265893504:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833154.318377:0:6655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.318670:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256446208 00000100:00100000:0.0:1788833154.318679:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256446208 00010000:00010000:0.0:1788833154.318717:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 8 pid: 6656 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.318767:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00100000:0.0:1788833154.318778:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2358:x1875727256446208:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833154.318793:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833154.318819:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 8 pid: 6656 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.318833:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 8 pid: 6656 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.318857:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000702fee1c/0x8c08e876ed3ff24c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b01a expref: 8 pid: 6656 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.318874:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833154.318879:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833154.318884:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.318893:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.318938:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833154.318998:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256446208:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 222us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833154.319006:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 58 00010000:00010000:3.0:1788833154.319291:0:6655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319301:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319326:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319342:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319350:0:6655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319357:0:6655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833154.319361:0:6655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319370:0:6655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319383:0:6655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.319391:0:6655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e1c5036/0x8c08e876ed3ff26f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833154.319456:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256446080:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 Request processed in 11562us (11707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833154.319464:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:2.0:1788833154.342252:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833154.347763:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256446464 00000100:00100000:1.0:1788833154.347781:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256446464 00000100:00100000:1.0:1788833154.347863:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 127 00000100:00100000:1.0:1788833154.347874:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+14:10549:x1875727256446464:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788833154.347948:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.347967:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.347979:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.348219:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.348231:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 15 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.348240:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.348293:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 15 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.348308:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 15 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833154.348323:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265893632:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833154.348420:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07f0b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833154.353161:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833154.353255:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256446592 00000100:00100000:0.0:1788833154.353265:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256446592 00010000:00010000:0.0:1788833154.353304:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 16 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.353348:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:0.0:1788833154.353358:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+16:2357:x1875727256446592:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833154.353373:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833154.353379:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 16 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.353393:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 16 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.353416:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:0.0:1788833154.353422:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.353431:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.353440:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.353472:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833154.353530:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+16:2357:x1875727256446592:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 174us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833154.353538:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 59 00010000:00010000:3.0:1788833154.353876:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b005 expref: 15 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833154.353906:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265893632:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833154.353927:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.353936:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.353942:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788833154.354202:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788833154.354339:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788833154.354379:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788833154.354446:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1875727265893760:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788833154.354488:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833154.354521:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea326dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833154.354664:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265893760 00000100:00100000:2.0:1788833154.354670:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265893760 00000100:00100000:2.0:1788833154.354712:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833154.354721:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5813:x1875727265893760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788833154.354800:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5813:x1875727265893760:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833154.354807:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788833154.355819:0:5813:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788833154.355828:0:5813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788833154.355846:0:5813:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea40fb1880, transno 4294967309 00000100:00100000:1.0:1788833154.355870:0:5813:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9cea40fb1180 x1875727265892608/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788833170 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833154.355881:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1875727265893760:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788833154.360189:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788833154.360287:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1875727265893888:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788833154.360354:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833154.360390:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788833154.361257:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265893888 00000100:00100000:3.0:1788833154.361267:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265893888 00000100:00100000:3.0:1788833154.361311:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788833154.361320:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5813:x1875727265893888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788833154.361543:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5813:x1875727265893888:12345-0@lo:1000:mdt00_002.0 Request processed in 223us (1188us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788833154.361551:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788833154.362017:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1875727265893888:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788833154.362082:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362092:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362100:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362106:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833154.362125:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362133:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362147:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:1.0:1788833154.362150:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833154.362155:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362162:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff27d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362190:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362197:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362203:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362208:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fa00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833154.362211:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362218:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362225:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833154.362227:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833154.362240:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362251:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362259:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.362291:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833154.362306:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265894016:192.168.206.55@tcp:105: 00000100:00100000:1.0:1788833154.362373:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea326dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833154.379974:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265894016:192.168.206.55@tcp:105: 00010000:00010000:0.0:1788833154.380015:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380026:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff1c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380100:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380113:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380124:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380134:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380141:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380166:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380172:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833154.380176:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380184:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380197:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833154.380200:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833154.380204:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380210:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff284 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380220:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380226:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380232:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380237:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833154.380240:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380258:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380266:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833154.380269:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788833154.380272:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.380277:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff276 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.380523:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+18:10549:x1875727256446464:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 32649us (38280us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1788833154.380533:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 127 00000020:00080000:0.0:1788833154.380539:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788833154.381224:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833154.381229:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833154.381742:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788833154.381751:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788833154.391795:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833154.393607:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833154.394699:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256446720 00000100:00100000:3.0:1788833154.394712:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256446720 00000100:00100000:3.0:1788833154.394760:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256446976 00000100:00100000:3.0:1788833154.394763:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256446976 00000100:00100000:3.0:1788833154.394779:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:3.0:1788833154.394789:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10548:x1875727256446720:12345-192.168.206.55@tcp:49:lfs.0 00000100:00100000:3.0:1788833154.394963:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:10548:x1875727256446720:12345-192.168.206.55@tcp:49:lfs.0 Request processed in 174us (3177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833154.394970:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:3.0:1788833154.394988:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:3.0:1788833154.394995:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:10549:x1875727256446976:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788833154.395853:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788833154.395991:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1788833154.396068:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.396086:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.396098:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.396107:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.396113:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.396118:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833154.396158:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788833154.396226:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+20:10549:x1875727256446976:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 1229us (2624us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788833154.396235:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 32 00000020:00080000:3.0:1788833154.396239:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788833154.396393:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833154.396400:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.396407:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833154.396411:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.396418:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.396431:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cea32de4e00) 00010000:00010000:2.0:1788833154.396440:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788833154.396445:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.396450:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff28b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833154.396549:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833154.396552:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833154.396554:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833154.401207:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833154.401325:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256447232 00000100:00100000:1.0:1788833154.401334:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256447232 00000100:00100000:1.0:1788833154.401447:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00100000:1.0:1788833154.401459:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+20:10548:x1875727256447232:12345-192.168.206.55@tcp:58:lfs.0 00000040:00080000:1.0:1788833154.401723:0:11926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788833154.401816:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+20:10548:x1875727256447232:12345-192.168.206.55@tcp:58:lfs.0 Request processed in 359us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833154.401825:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00100000:0.0:1788833154.436221:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833154.436316:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256447360 00000100:00100000:1.0:1788833154.436325:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256447360 00000100:00100000:1.0:1788833154.436391:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 129 00000100:00100000:1.0:1788833154.436403:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+20:10551:x1875727256447360:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833154.436423:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833154.436456:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff292 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b021 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436529:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436543:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436553:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436566:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436572:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436578:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436803:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436813:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 21 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436820:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436861:0:8616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 21 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.436885:0:8616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 21 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833154.436899:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265894144:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833154.436982:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833154.440094:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265894144:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833154.440126:0:8616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.444873:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833154.445204:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256447616 00000100:00100000:1.0:1788833154.445215:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256447616 00000100:00100000:1.0:1788833154.445274:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:1.0:1788833154.445284:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+22:5597:x1875727256447616:12345-192.168.206.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788833154.445682:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+23:5597:x1875727256447616:12345-192.168.206.55@tcp:35:ldlm_bl.0 Request processed in 398us (816us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788833154.445691:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:2.0:1788833154.448260:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833154.448356:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256447744 00000100:00100000:0.0:1788833154.448441:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256447744 00010000:00010000:0.0:1788833154.448490:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 23 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833154.448531:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:0.0:1788833154.448541:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+23:2358:x1875727256447744:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833154.448556:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833154.448563:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 23 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.448607:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 23 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.448640:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff1b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe2 expref: 23 pid: 11926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.448656:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833154.448662:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.448671:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.448678:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833154.448713:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833154.448815:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+22:2358:x1875727256447744:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 275us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833154.448822:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 60 00010000:00010000:1.0:1788833154.449660:0:8616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449674:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833154.449720:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788833154.449724:0:8616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833154.449744:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449775:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449786:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449793:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449800:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449806:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833154.449811:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449818:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449831:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:1.0:1788833154.449835:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833154.449839:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449845:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449873:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449879:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449894:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449900:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fa00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833154.449903:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449910:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449919:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cea0884e400) 00010000:00010000:1.0:1788833154.449921:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833154.449925:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449931:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fa00/0x8c08e876ed3ff2a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449970:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff292 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b021 expref: 22 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449986:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b021 expref: 21 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833154.449994:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833154.449996:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833154.449999:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fe00, rc 0) 00000100:00100000:1.0:1788833154.450095:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10551:x1875727256447360:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 13694us (13881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833154.450113:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 129 00010000:00010000:3.0:1788833155.053264:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788833155.166279:0:12071:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833155.166287:0:12071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833155.166336:0:12071:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788833155.166346:0:12071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788833155.437818:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833155.437830:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833155.437872:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788833155.437879:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788833155.437993:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265894272:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788833155.438129:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea326da9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833155.445908:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea396c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265894272:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788833155.452295:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833155.455317:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256447872 00000100:00100000:0.0:1788833155.455331:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256447872 00000100:00100000:2.0:1788833155.458270:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 130 00000100:00100000:2.0:1788833155.458286:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10563:x1875727256447872:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788833155.458320:0:5813:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788833155.458430:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10563:x1875727256447872:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 149us (6143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833155.458438:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 130 00000100:00100000:2.0:1788833155.462341:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833155.462421:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256448128 00000100:00100000:3.0:1788833155.462431:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256448128 00000100:00100000:3.0:1788833155.462496:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 131 00000100:00100000:3.0:1788833155.462507:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+21:10563:x1875727256448128:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833155.462526:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833155.462548:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff2ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b028 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833155.462684:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833155.462698:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833155.462708:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833155.462719:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788833155.462844:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff2ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b028 expref: 24 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833155.462863:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b028 expref: 23 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833155.462871:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:3.0:1788833155.462875:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833155.462878:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dce00, rc 0) 00000100:00100000:3.0:1788833155.462941:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+23:10563:x1875727256448128:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 436us (608us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788833155.462948:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 131 00000100:00080000:1.0:1788833155.463773:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833155.473192:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833155.473490:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256448384 00000100:00100000:1.0:1788833155.473501:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256448384 00000100:00100000:1.0:1788833155.473559:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 132 00000100:00100000:1.0:1788833155.473570:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea396c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+23:10563:x1875727256448384:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788833155.473661:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.473679:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.473691:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.473858:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.473866:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.473872:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.473878:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932ea00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833155.473882:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.473888:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.474011:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833155.474014:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788833155.474019:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.474025:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff2c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833155.474460:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea396c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+24:10563:x1875727256448384:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 890us (1276us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788833155.474469:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 132 00000040:00080000:3.0:1788833155.475408:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833155.475414:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833155.475922:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788833155.475934:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788833155.477858:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833155.478141:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256448640 00000100:00100000:3.0:1788833155.478163:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256448640 00000100:00100000:3.0:1788833155.478221:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:3.0:1788833155.478232:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+24:10563:x1875727256448640:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788833155.478874:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+25:10563:x1875727256448640:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 642us (1023us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788833155.478884:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:2.0:1788833155.482823:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833155.482980:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256448768 00000100:00100000:1.0:1788833155.482989:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256448768 00000100:00100000:1.0:1788833155.483055:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1788833155.483065:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+25:2358:x1875727256448768:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833155.483080:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833155.483105:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff2b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b028 expref: 25 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833155.483126:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833155.483131:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833155.485090:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+24:2358:x1875727256448768:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 2015us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833155.485103:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00010000:00010000:3.0:1788833156.078817:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833156.793953:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788833156.793973:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:2.0:1788833157.048626:0:12124:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788833157.048635:0:12124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788833157.048695:0:12124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788833157.048702:0:12124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788833157.101284:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833157.245721:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833157.250507:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449024 00000100:00100000:0.0:1788833157.250521:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449024 00000100:00100000:0.0:1788833157.250756:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 133 00000100:00100000:0.0:1788833157.250767:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+24:10583:x1875727256449024:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833157.250805:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833157.250826:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff2ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b02f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833157.250922:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff2d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833157.250937:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833157.250947:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833157.250957:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:1.0:1788833157.251124:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788833157.251255:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff2ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b02f expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833157.251275:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b02f expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833157.251283:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:0.0:1788833157.251286:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788833157.251289:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ba00, rc 0) 00000100:00100000:0.0:1788833157.251354:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+26:10583:x1875727256449024:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 589us (5641us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788833157.251361:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 133 00000100:00100000:0.0:1788833157.254664:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833157.254749:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449152 00000100:00100000:2.0:1788833157.254758:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449152 00000100:00100000:2.0:1788833157.254866:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 134 00000100:00100000:2.0:1788833157.254888:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+26:10583:x1875727256449152:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:2.0:1788833157.254953:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.254968:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.254979:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.255000:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.255005:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.255011:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.255017:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833157.255021:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.255028:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.255080:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:2.0:1788833157.255084:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833157.255088:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833157.255094:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff2df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833157.255170:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+26:10583:x1875727256449152:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 283us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833157.255178:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 134 00000100:00100000:3.0:1788833157.379181:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833157.379298:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449280 00000100:00100000:1.0:1788833157.379313:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449280 00000100:00100000:1.0:1788833157.379433:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:1.0:1788833157.379444:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2359:x1875727256449280:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:1.0:1788833157.379460:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833157.379480:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca8b563/0x8c08e876ed3ff2e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b036 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833157.379508:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f6d80, atime: 0x6a9f6d80, ctime: 0x6a9f6d80, blocks: 0xb 00010000:00010000:1.0:1788833157.379526:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:1.0:1788833157.379531:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833157.379540:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8b563/0x8c08e876ed3ff2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b036 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833157.379558:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ca8b563/0x8c08e876ed3ff2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b036 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833157.379570:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fa00, rc 0) 00000100:00100000:1.0:1788833157.379661:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2359:x1875727256449280:12345-192.168.206.55@tcp:101:cat.0 Request processed in 218us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833157.379668:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00080000:3.0:1788833157.380174:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833157.388760:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833157.388878:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449408 00000100:00100000:1.0:1788833157.388893:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449408 00002000:00100000:1.0:1788833157.388949:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9cea1fd47480 x1875727256449408/t0(0) o3->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:343/0 lens 488/0 e 0 to 0 dl 1788833168 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788833157.388960:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1fd47480 with x1875727256449408 ext(0->4095) 00002000:00010000:1.0:1788833157.388965:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea1fd47480 00000100:00100000:1.0:1788833157.389003:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:1.0:1788833157.389025:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256449408:12345-192.168.206.55@tcp:3:cat.0 00000100:00100000:0.0:1788833157.389550:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256449408:12345-192.168.206.55@tcp:3:cat.0 Request processed in 524us (801us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788833157.389570:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00002000:00100000:0.0:1788833157.389578:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9cea1fd47480 x1875727256449408/t0(0) o3->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:343/0 lens 488/4536 e 0 to 0 dl 1788833168 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788833157.389587:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1fd47480 with x1875727256449408 ext(0->4095) 00002000:00010000:0.0:1788833157.389590:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea1fd47480 00000100:00100000:0.0:1788833157.844195:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833157.844246:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833157.844283:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833157.844317:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833157.844353:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833157.844390:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256450048 00000100:00100000:0.0:1788833157.844390:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449792 00000100:00100000:1.0:1788833157.844404:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256450048 00000100:00100000:0.0:1788833157.844404:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449792 00000100:00100000:1.0:1788833157.844472:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449664 00000100:00100000:1.0:1788833157.844477:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449664 00000100:00100000:0.0:1788833157.844480:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449920 00000100:00100000:0.0:1788833157.844486:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449920 00000100:00100000:1.0:1788833157.844511:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 132 00000100:00100000:0.0:1788833157.844521:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:0.0:1788833157.844531:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2360:x1875727256449792:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833157.844538:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea06749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256450048:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833157.844648:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 76 00000100:00100000:3.0:1788833157.844660:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256449920:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833157.844790:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2360:x1875727256449792:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 260us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833157.844799:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:0.0:1788833157.844827:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 133 00000100:00100000:0.0:1788833157.844847:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+26:2360:x1875727256449664:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833157.844917:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256449536 00000100:00100000:2.0:1788833157.844923:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256449536 00000100:00100000:2.0:1788833157.844967:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 286 00000100:00100000:2.0:1788833157.844975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256449536:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833157.847909:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea06749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2360:x1875727256450048:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 3359us (3607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833157.847939:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 132 00000100:00080000:1.0:1788833157.848730:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833157.848741:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833157.848950:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256449920:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 4285us (4588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833157.848964:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 76 00000100:00100000:0.0:1788833157.852467:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+26:2360:x1875727256449664:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 7588us (8116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833157.852486:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 133 00000100:00100000:2.0:1788833157.858424:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256449536:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 13431us (14234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833157.858443:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 286 00010000:00010000:3.0:1788833158.125312:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833158.765431:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265894400:0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.765531:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833158.765644:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265894400 00000100:00100000:3.0:1788833158.765655:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265894400 00000100:00100000:1.0:1788833158.765722:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0392a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265894784:0@lo:400:kworker.0 00000100:00100000:1.0:1788833158.765774:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833158.765912:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788833158.765915:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833158.765924:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265894400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833158.765991:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265894400:12345-0@lo:400:kworker.0 Request processed in 70us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833158.766000:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788833158.766021:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265894528:0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.766126:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265894656:0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.766161:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833158.766323:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833158.766349:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265895040:0@lo:400:kworker.0 00000100:00100000:0.0:1788833158.766373:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833158.766407:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265894784 00000100:00100000:0.0:1788833158.766413:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265894784 00000100:00100000:1.0:1788833158.766436:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265894656 00000100:00100000:1.0:1788833158.766441:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265894656 00000100:00100000:0.0:1788833158.766458:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895040 00000100:00100000:0.0:1788833158.766460:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895040 00000100:00100000:1.0:1788833158.766472:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265894528 00000100:00100000:1.0:1788833158.766475:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265894528 00000100:00100000:1.0:1788833158.766495:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788833158.766495:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788833158.766503:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265894656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833158.766503:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265894784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.766584:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788833158.766594:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265894528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833158.766614:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265894656:12345-0@lo:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833158.766640:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265894528:12345-0@lo:400:kworker.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833158.766640:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788833158.766646:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788833158.766685:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265894656:0@lo:400:kworker.0 00000100:00080000:1.0:1788833158.767092:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833158.767099:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788833158.767102:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833158.767119:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788833158.767130:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265895040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833158.767174:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265895040:12345-0@lo:400:kworker.0 Request processed in 47us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833158.767181:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788833158.767213:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265894400:0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.767277:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea0392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265894912:0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.767309:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833158.767365:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265894912 00000100:00100000:3.0:1788833158.767371:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265894912 00000100:00100000:3.0:1788833158.767419:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788833158.767426:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265894912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833158.767463:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265894912:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833158.767469:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788833158.767683:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265894784:12345-0@lo:400:kworker.0 Request processed in 1053us (1780us total) trans 0 rc 0/0 00000100:00080000:1.0:1788833158.767685:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833158.767695:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788833158.767740:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265894528:0@lo:400:kworker.0 00000100:00100000:0.0:1788833158.767752:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788833158.767757:0:3278:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788833158.767912:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea3fb2c000, transno 4294967304 00000100:00100000:0.0:1788833158.767968:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265895040:0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.768225:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0392a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265894784:0@lo:400:kworker.0 00000100:00100000:2.0:1788833158.768268:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea0392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265894912:0@lo:400:kworker.0 00010000:00010000:1.0:1788833159.150923:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833159.279385:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833159.279416:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265895296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833159.279511:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833159.280005:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895296 00000100:00100000:1.0:1788833159.280015:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895296 00000100:00100000:1.0:1788833159.280095:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788833159.280106:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265895296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833159.280152:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833159.280309:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265895168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833159.280361:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833159.285404:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788833159.285430:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788833159.286708:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265895296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6590us (7184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833159.287325:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788833159.287374:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895168 00000100:00100000:1.0:1788833159.287385:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895168 00000100:00100000:2.0:1788833159.288336:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788833159.288356:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265895168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833159.288411:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833159.288635:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265895168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (8271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833159.288643:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788833159.288722:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265895168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833159.289020:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265895296:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788833159.399906:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788833159.399934:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cea07f0b6c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788833159.399941:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f643c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cea07f0b600 00000020:00080000:0.0:1788833159.399945:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f643800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea065f4000 00000020:00080000:0.0:1788833159.399981:0:5835:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:0.0:1788833159.399989:0:5835:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788833159.401398:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788833159.401841:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788833159.432426:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788833159.432466:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1788833160.173250:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833160.621411:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833160.621423:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833160.621898:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788833160.621905:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788833161.199216:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833162.221521:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833162.694290:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833162.694451:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256450176 00000100:00100000:2.0:1788833162.694461:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256450176 00000100:00100000:2.0:1788833162.694534:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 135 00000100:00100000:2.0:1788833162.694544:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+13:10228:x1875727256450176:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788833162.694661:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+13:10228:x1875727256450176:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 Request processed in 118us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833162.694669:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 135 00000100:00080000:1.0:1788833162.695441:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833162.696950:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833162.697212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256450432 00000100:00100000:3.0:1788833162.697220:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256450432 00000100:00100000:3.0:1788833162.697340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:3.0:1788833162.697352:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:10228:x1875727256450432:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788833162.697679:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:10228:x1875727256450432:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 328us (745us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788833162.697687:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:0.0:1788833162.943684:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833162.943771:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256450560 00000100:00100000:1.0:1788833162.943785:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256450560 00000100:00100000:1.0:1788833162.943885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 136 00000100:00100000:1.0:1788833162.943899:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:11036:x1875727256450560:12345-192.168.206.55@tcp:101:lsof.0 00010000:00010000:1.0:1788833162.943927:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833162.943954:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff2ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b03d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833162.944114:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833162.944135:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833162.944154:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833162.944205:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788833162.944209:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833162.944255:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833162.944281:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff2ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833162.944316:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833162.944326:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:1.0:1788833162.944329:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833162.944334:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fc00, rc 0) 00000100:00100000:1.0:1788833162.944396:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:11036:x1875727256450560:12345-192.168.206.55@tcp:101:lsof.0 Request processed in 501us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833162.944404:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 136 00000100:00080000:2.0:1788833162.945148:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833162.961184:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833162.961250:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833162.961289:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833162.961464:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256450816 00000100:00100000:0.0:1788833162.961478:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256450816 00000100:00100000:3.0:1788833162.961547:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256450688 00000100:00100000:3.0:1788833162.961554:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256450688 00000100:00100000:0.0:1788833162.961564:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256450944 00000100:00100000:0.0:1788833162.961569:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256450944 00000100:00100000:3.0:1788833162.961611:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 288 00000100:00100000:0.0:1788833162.961621:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:3.0:1788833162.961628:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256450688:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833162.961636:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256450816:12345-192.168.206.55@tcp:400:kworker.0 00000100:00080000:1.0:1788833162.961730:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833162.961736:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833162.961741:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256450688:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 119us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833162.961751:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 288 00000100:00100000:1.0:1788833162.961778:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:1.0:1788833162.961790:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256450944:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833162.964130:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256450816:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 2389us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833162.964149:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:0.0:1788833162.964708:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256450944:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 2918us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833162.964718:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 80 00010000:00010000:2.0:1788833163.245242:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833163.885720:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265895808:0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.885804:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265895552:0@lo:400:kworker.0 00000100:00100000:0.0:1788833163.885810:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833163.885889:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265895424:0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.885943:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833163.886003:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265896064:0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886054:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833163.886089:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833163.886095:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265895680:0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886121:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833163.886155:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895552 00000100:00100000:1.0:1788833163.886181:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895552 00000100:00100000:1.0:1788833163.886229:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895680 00000100:00100000:1.0:1788833163.886231:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895680 00000100:00100000:1.0:1788833163.886259:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788833163.886268:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265895552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886318:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265895552:12345-0@lo:400:kworker.0 Request processed in 52us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833163.886326:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788833163.886342:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788833163.886347:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265895680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886368:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265895680:12345-0@lo:400:kworker.0 Request processed in 22us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833163.886374:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1788833163.886397:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833163.886427:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265895680:0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886437:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265895552:0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886468:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895808 00000100:00100000:1.0:1788833163.886471:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895808 00000100:00100000:1.0:1788833163.886504:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896064 00000100:00100000:1.0:1788833163.886507:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896064 00000100:00100000:1.0:1788833163.886529:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788833163.886535:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265895808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886567:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265895808:12345-0@lo:400:kworker.0 Request processed in 33us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833163.886586:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788833163.886597:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788833163.886603:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265896064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.886645:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265896064:12345-0@lo:400:kworker.0 Request processed in 42us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833163.886652:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788833163.886670:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833163.886673:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833163.886687:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265896064:0@lo:400:kworker.0 00000100:00100000:0.0:1788833163.889405:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788833163.889420:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea40fb1180, transno 4294967310 00000004:00080000:0.0:1788833163.889522:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788833163.889560:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265895808:0@lo:400:kworker.0 00000100:00100000:2.0:1788833163.891625:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833163.896163:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265895936:0@lo:400:kworker.0 00000100:00100000:2.0:1788833163.896276:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833163.897320:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895424 00000100:00100000:3.0:1788833163.897334:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895424 00000100:00100000:3.0:1788833163.897490:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788833163.897504:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265895424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833163.899001:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3277:x1875727265895424:12345-0@lo:400:kworker.0 Request processed in 1490us (7376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833163.899016:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788833163.899290:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3277:1875727265895424:0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.904123:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265895936 00000100:00100000:1.0:1788833163.904142:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265895936 00000100:00100000:1.0:1788833163.904248:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788833163.904261:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265895936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833163.904380:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265895936:12345-0@lo:400:kworker.0 Request processed in 121us (8103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833163.904389:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788833163.904594:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833163.904654:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265895936:0@lo:400:kworker.0 00010000:00010000:3.0:1788833164.270016:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833164.397839:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788833164.399010:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265896320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833164.399147:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833164.399746:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896320 00000100:00100000:2.0:1788833164.399757:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896320 00000100:00100000:2.0:1788833164.399814:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788833164.399825:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265896320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833164.399883:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833164.399958:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265896320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833164.399966:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788833164.401852:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265896320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833164.404508:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265896192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833164.404621:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833164.404845:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896192 00000100:00100000:1.0:1788833164.404885:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896192 00000100:00100000:1.0:1788833164.405317:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788833164.405332:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265896192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833164.405389:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833164.405456:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265896192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833164.405464:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788833164.405629:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265896192:0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1788833164.488371:0:5835:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1788833164.488401:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788833164.488465:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788833164.488475:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788833165.293232:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788833166.122690:0:12326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:06:04 (1788833164) 00010000:00010000:2.0:1788833166.321521:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833167.252207:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833167.252443:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256451200 00000100:00100000:1.0:1788833167.252454:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256451200 00000100:00100000:1.0:1788833167.252547:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 137 00000100:00100000:1.0:1788833167.252567:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+13:11300:x1875727256451200:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833167.252591:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833167.252610:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff2fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b044 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.252686:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.252701:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.252714:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.252740:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.252748:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.252755:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253282:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fadc00/0x8c08e876ed3ff310 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253293:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fadc00/0x8c08e876ed3ff310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253301:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fadc00/0x8c08e876ed3ff310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833167.253321:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788833167.253598:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253607:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253614:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253620:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932ea00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833167.253624:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253632:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253644:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cea08db1000) 00010000:00010000:1.0:1788833167.253648:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833167.253652:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253659:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ea00/0x8c08e876ed3ff302 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253670:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253677:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253693:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253698:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833167.253701:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253708:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253716:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cea0884e500) 00010000:00010000:1.0:1788833167.253719:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833167.253722:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.253728:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac200/0x8c08e876ed3ff309 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.255121:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3ff2fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b044 expref: 16 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.255138:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fadc00/0x8c08e876ed3ff310 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b044 expref: 15 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833167.255147:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:1.0:1788833167.255150:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833167.255153:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fadc00, rc 0) 00000100:00100000:1.0:1788833167.255228:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+15:11300:x1875727256451200:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 2672us (3030us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788833167.255247:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 137 00000100:00080000:0.0:1788833167.255350:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833167.260293:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833167.260344:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833167.260582:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256451328 00000100:00100000:2.0:1788833167.260592:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256451328 00000100:00100000:2.0:1788833167.260647:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:2.0:1788833167.260656:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+15:2358:x1875727256451328:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833167.260677:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833167.260707:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fadc00/0x8c08e876ed3ff310 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b044 expref: 15 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833167.260724:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:2.0:1788833167.260729:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833167.260786:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:2358:x1875727256451328:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 131us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833167.260794:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:1.0:1788833167.261275:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256451456 00000100:00100000:1.0:1788833167.261280:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256451456 00000100:00100000:1.0:1788833167.261325:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 138 00000100:00100000:1.0:1788833167.261334:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+14:11300:x1875727256451456:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788833167.261416:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+14:11300:x1875727256451456:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 Request processed in 82us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833167.261423:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 138 00010000:00010000:3.0:1788833167.345382:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833167.789257:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833167.789266:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833167.789788:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788833167.789798:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788833168.082629:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833168.082665:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256451712 00000100:00100000:3.0:1788833168.082672:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833168.082679:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256451712 00000100:00100000:3.0:1788833168.082725:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833168.082752:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 140 00000100:00100000:3.0:1788833168.082758:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833168.082768:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:2358:x1875727256451712:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833168.082793:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833168.082822:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256451584 00000100:00100000:3.0:1788833168.082827:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256451584 00000100:00100000:1.0:1788833168.082863:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:2358:x1875727256451712:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833168.082867:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 290 00000100:00100000:1.0:1788833168.082877:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 140 00000100:00100000:3.0:1788833168.082882:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256451584:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833168.082900:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256452096 00000100:00100000:1.0:1788833168.082905:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256452096 00000100:00100000:3.0:1788833168.082915:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256451584:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833168.082922:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 290 00000100:00100000:1.0:1788833168.082961:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 141 00000100:00100000:1.0:1788833168.082968:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2358:x1875727256452096:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833168.082974:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256451968 00000100:00100000:2.0:1788833168.082986:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256451968 00000100:00100000:1.0:1788833168.082996:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2358:x1875727256452096:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 29us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833168.083011:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 141 00000100:00100000:2.0:1788833168.083025:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256451840 00000100:00100000:2.0:1788833168.083050:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256451840 00000100:00100000:1.0:1788833168.083055:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:1.0:1788833168.083062:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256451968:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833168.083077:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00100000:2.0:1788833168.083083:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256451840:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833168.083090:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256451968:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833168.083097:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:2.0:1788833168.083107:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256451840:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833168.083114:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00080000:1.0:1788833168.083256:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788833168.083262:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833168.083264:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788833168.371563:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833169.006004:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265896576:0@lo:400:kworker.0 00000100:00100000:3.0:1788833169.006093:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833169.006155:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265897088:0@lo:400:kworker.0 00000100:00100000:3.0:1788833169.006181:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833169.006507:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265896832:0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.006542:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833169.006582:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788833169.006589:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265896448:0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.006616:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833169.006638:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265896960:0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.006659:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833169.006686:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265897088 00000100:00100000:1.0:1788833169.006693:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265897088 00000100:00100000:1.0:1788833169.006738:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896832 00000100:00100000:1.0:1788833169.006742:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896832 00000100:00100000:1.0:1788833169.006767:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788833169.006777:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265897088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.006832:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265897088:12345-0@lo:400:kworker.0 Request processed in 57us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.006839:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788833169.006886:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788833169.006893:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265896832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.006936:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265896832:12345-0@lo:400:kworker.0 Request processed in 43us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.006941:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788833169.006963:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896448 00000100:00100000:1.0:1788833169.006967:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896448 00000100:00100000:1.0:1788833169.006991:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788833169.006997:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265896448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.007025:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3276:x1875727265896448:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.007052:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788833169.007078:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896576 00000100:00100000:1.0:1788833169.007081:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896576 00000100:00100000:1.0:1788833169.007103:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896960 00000100:00100000:1.0:1788833169.007106:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896960 00000100:00100000:1.0:1788833169.007124:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788833169.007131:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265896576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.007161:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265896576:12345-0@lo:400:kworker.0 Request processed in 31us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.007167:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788833169.007179:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788833169.007186:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265896960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833169.007213:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265896448:0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.007220:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265896960:12345-0@lo:400:kworker.0 Request processed in 34us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.007228:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788833169.007246:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833169.007248:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265896960:0@lo:400:kworker.0 00000100:00080000:1.0:1788833169.007257:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788833169.007261:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833169.007264:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265896832:0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.007306:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265896576:0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.007317:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265897088:0@lo:400:kworker.0 00000100:00100000:2.0:1788833169.008141:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265896704:0@lo:400:kworker.0 00000100:00100000:1.0:1788833169.009559:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833169.011008:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265896704 00000100:00100000:2.0:1788833169.011018:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265896704 00000100:00100000:2.0:1788833169.011111:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788833169.011121:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265896704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833169.011199:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265896704:12345-0@lo:400:kworker.0 Request processed in 80us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833169.011206:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788833169.011249:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265896704:0@lo:400:kworker.0 00000100:00080000:1.0:1788833169.011319:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788833169.394734:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833169.398973:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.399065:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256452224 00000100:00100000:3.0:1788833169.399081:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256452224 00000100:00080000:0.0:1788833169.399111:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833169.399153:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 139 00000100:00100000:3.0:1788833169.399163:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+14:11343:x1875727256452224:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833169.399180:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833169.399199:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b04b expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399257:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399269:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399279:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399292:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399298:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399304:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399495:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399503:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399509:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399520:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833169.399524:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399531:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.399542:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:3.0:1788833169.400074:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833169.400080:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400091:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400104:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400110:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400116:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400121:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dce00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833169.400124:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400130:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400152:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cea32de4700) 00010000:00010000:3.0:1788833169.400154:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833169.400157:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400162:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff32c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400195:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff31e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b04b expref: 15 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400205:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:3.0:1788833169.400207:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833169.400210:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b04b expref: 15 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.400218:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833169.400273:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+14:11343:x1875727256452224:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 1112us (1306us total) trans 0 rc 301/301 00000100:00100000:3.0:1788833169.400280:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 139 00000100:00100000:1.0:1788833169.407251:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833169.407552:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256452480 00000100:00100000:2.0:1788833169.407561:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256452480 00000100:00100000:2.0:1788833169.407621:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 140 00000100:00100000:2.0:1788833169.407635:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+14:11343:x1875727256452480:12345-192.168.206.55@tcp:36:lfs.0 00010000:00010000:2.0:1788833169.407686:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833169.407711:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477400/0x8c08e876ed3fec9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae84 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.407755:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:2.0:1788833169.407760:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833169.407949:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.407964:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.407971:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.408004:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.408017:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 5 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833169.408053:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265897216:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833169.408211:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833169.414764:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833169.414805:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256452608 00000100:00100000:1.0:1788833169.414813:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256452608 00010000:00010000:1.0:1788833169.414850:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 6 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833169.414886:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:1.0:1788833169.414896:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2358:x1875727256452608:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833169.414909:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833169.414915:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 6 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.414928:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 6 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.414948:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:1.0:1788833169.414954:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.414963:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.414982:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.414998:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833169.415058:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2358:x1875727256452608:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 163us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.415066:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 61 00010000:00010000:2.0:1788833169.415201:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed3ff2f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b03d expref: 5 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833169.415216:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265897216:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833169.415234:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.415242:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.415254:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.415273:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.415282:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.415290:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833169.416246:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788833169.416258:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.416266:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.416274:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.416280:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833169.416285:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.416292:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.416304:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea08db1500) 00010000:00010000:2.0:1788833169.416306:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833169.416316:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.416323:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff333 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833169.416338:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012569413 reply state 00000000def19e30 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833169.416346:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833169.416413:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+15:11343:x1875727256452480:12345-192.168.206.55@tcp:36:lfs.0 Request processed in 8783us (9168us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788833169.416421:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 140 00010000:00010000:0.0:1788833169.424209:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.424226:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.424234:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.424240:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833169.424245:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.424253:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.424269:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cea1539cd00) 00010000:00010000:0.0:1788833169.424273:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833169.424277:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.424284:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff33a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833169.486138:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.486237:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256452736 00000100:00100000:3.0:1788833169.486247:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256452736 00000100:00100000:3.0:1788833169.486353:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 141 00000100:00100000:3.0:1788833169.486364:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+14:11351:x1875727256452736:12345-192.168.206.55@tcp:101:lctl.0 00010000:00010000:3.0:1788833169.486385:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833169.486406:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b052 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.486481:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff348 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.486493:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.486502:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833169.486535:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788833169.486539:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833169.486569:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.486592:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b052 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.486611:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff348 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b052 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.486620:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:3.0:1788833169.486622:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833169.486626:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dce00, rc 0) 00000100:00100000:3.0:1788833169.486686:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+15:11351:x1875727256452736:12345-192.168.206.55@tcp:101:lctl.0 Request processed in 324us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833169.486693:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 141 00000100:00100000:0.0:1788833169.517490:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788833169.517706:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265897344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833169.518009:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265897472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833169.518088:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833169.518665:0:12183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265897472 00000100:00100000:2.0:1788833169.518674:0:12183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265897472 00000100:00100000:2.0:1788833169.518736:0:12183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833169.518746:0:12183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265897472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833169.518778:0:12183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833169.518831:0:12183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265897472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833169.518839:0:12183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833169.519193:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265897472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833169.519637:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833169.519674:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265897344 00000100:00100000:0.0:1788833169.519679:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265897344 00000100:00100000:0.0:1788833169.519711:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788833169.519719:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265897344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833169.519741:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833169.519778:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265897344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833169.519785:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788833169.519819:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265897344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833169.559808:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833169.561425:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256452864 00000100:00100000:0.0:1788833169.561440:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256452864 00000100:00100000:0.0:1788833169.561505:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 142 00000100:00100000:0.0:1788833169.561515:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+15:11357:x1875727256452864:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833169.561535:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833169.561563:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff34f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b059 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561624:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561637:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561649:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561662:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561682:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561690:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561953:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561963:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.561970:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833169.561996:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788833169.561999:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833169.562016:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562060:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562068:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562075:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562082:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833169.562086:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562101:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562113:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:0.0:1788833169.562116:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833169.562120:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562127:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562138:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562144:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562150:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562155:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925bc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833169.562158:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562164:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562171:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cea08db1400) 00010000:00010000:0.0:1788833169.562174:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833169.562176:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562192:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff35d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562225:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff34f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b059 expref: 17 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562238:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b059 expref: 16 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.562246:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833169.562248:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788833169.562250:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ac00, rc 0) 00000100:00100000:0.0:1788833169.562306:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+16:11357:x1875727256452864:12345-192.168.206.55@tcp:101:bash.0 Request processed in 793us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833169.562313:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 142 00000100:00100000:1.0:1788833169.573017:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.574533:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256453120 00000100:00100000:3.0:1788833169.574557:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256453120 00000100:00100000:3.0:1788833169.574619:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 143 00000100:00100000:3.0:1788833169.574630:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+16:11357:x1875727256453120:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833169.574650:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833169.574669:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff36b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b060 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.574883:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.574897:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.574908:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.574964:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.574971:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.574977:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788833169.577955:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788833169.578264:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578280:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578298:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578336:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578343:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578349:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578355:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833169.578358:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578364:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.578376:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:3.0:1788833169.578379:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833169.578382:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.579258:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff372 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833169.579278:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c1387cd reply state 0000000008ff1409 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833169.579287:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788833169.579340:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff36b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.579355:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.579364:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833169.579366:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833169.579369:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dca00, rc 0) 00000100:00100000:3.0:1788833169.579453:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11357:x1875727256453120:12345-192.168.206.55@tcp:101:bash.0 Request processed in 4825us (6447us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788833169.579461:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 143 00010000:00010000:3.0:1788833169.583784:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.583799:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.583806:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.583811:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833169.583816:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.583822:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.583837:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea32de4700) 00010000:00010000:3.0:1788833169.583839:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833169.583851:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.583857:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff379 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833169.592627:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.593113:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256453248 00000100:00100000:3.0:1788833169.593125:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256453248 00000100:00100000:3.0:1788833169.593189:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:3.0:1788833169.593199:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2360:x1875727256453248:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833169.593217:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833169.593236:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b067 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833169.593259:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788833169.593278:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1788833169.593282:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833169.593293:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.593309:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 6 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.593321:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833169.593370:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2360:x1875727256453248:12345-192.168.206.55@tcp:101:bash.0 Request processed in 173us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833169.593376:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:3.0:1788833169.599147:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833169.599238:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256453376 00000100:00100000:0.0:1788833169.599247:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256453376 00000100:00100000:0.0:1788833169.599306:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:0.0:1788833169.599316:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:11357:x1875727256453376:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833169.599336:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833169.599356:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b06e expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.599402:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 7 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.599424:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833169.599429:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833169.599435:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.599470:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 7 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.599482:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 7 pid: 6654 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833169.599497:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875727265897600:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833169.599584:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1264c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833169.603265:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875727265897600:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833169.603299:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.603321:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b000, rc 0) 00000100:00100000:0.0:1788833169.603374:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:11357:x1875727256453376:12345-192.168.206.55@tcp:101:bash.0 Request processed in 4057us (4236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833169.603382:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:3.0:1788833169.603616:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833169.603977:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256453504 00000100:00100000:0.0:1788833169.603985:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256453504 00010000:00010000:0.0:1788833169.604017:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 7 pid: 6654 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833169.604089:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:0.0:1788833169.604101:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256453504:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833169.604116:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833169.604138:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 7 pid: 6654 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.604151:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 7 pid: 6654 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.604175:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff38e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b067 expref: 7 pid: 6654 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.604191:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833169.604195:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833169.604202:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.604211:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.604241:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833169.604253:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265897728:192.168.206.55@tcp:105: 00000100:00100000:0.0:1788833169.604319:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1264c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833169.610262:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833169.610331:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256453760 00000100:00100000:1.0:1788833169.610340:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256453760 00000100:00100000:1.0:1788833169.610389:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:1.0:1788833169.610399:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11357:x1875727256453760:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:1.0:1788833169.610745:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11357:x1875727256453760:12345-192.168.206.55@tcp:35:bash.0 Request processed in 346us (490us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788833169.610753:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:0.0:1788833169.610878:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265897728:192.168.206.55@tcp:105: 00010000:00010000:0.0:1788833169.610899:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833169.610920:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256453504:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 6823us (7305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833169.610927:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 62 00000001:00080000:0.0:1788833169.618497:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000001:00080000:0.0:1788833169.618516:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000100:00100000:2.0:1788833169.713257:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.715100:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256454016 00000100:00100000:3.0:1788833169.715121:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256454016 00000100:00100000:3.0:1788833169.715213:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 144 00000100:00100000:3.0:1788833169.715225:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+17:11367:x1875727256454016:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833169.715258:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833169.715286:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b075 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833169.715415:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788833169.715613:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff39c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b075 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.715633:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:3.0:1788833169.715637:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833169.715645:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b075 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.715670:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dc600, rc 0) 00000100:00100000:3.0:1788833169.715791:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11367:x1875727256454016:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 568us (2551us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1788833169.715800:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 144 00000100:00100000:2.0:1788833169.725208:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.727335:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256454272 00000100:00100000:3.0:1788833169.727355:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256454272 00000100:00100000:3.0:1788833169.727479:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:3.0:1788833169.727493:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11367:x1875727256454272:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833169.729898:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11367:x1875727256454272:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 2392us (4694us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788833169.729915:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:1.0:1788833169.824082:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833169.824220:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256454400 00000100:00100000:2.0:1788833169.824230:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256454400 00000100:00100000:2.0:1788833169.824287:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 145 00000100:00100000:2.0:1788833169.824296:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11373:x1875727256454400:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833169.824332:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833169.824353:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff3aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b07c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.824419:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.824434:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.824444:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833169.824478:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788833169.824482:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833169.824499:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.824524:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff3aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b07c expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.824655:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b07c expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.824665:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:2.0:1788833169.824668:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833169.824671:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036800, rc 0) 00000100:00100000:2.0:1788833169.824785:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+20:11373:x1875727256454400:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 489us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833169.824793:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 145 00000100:00100000:2.0:1788833169.837788:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.838056:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256454656 00000100:00100000:3.0:1788833169.838065:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256454656 00000100:00100000:3.0:1788833169.838129:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 146 00000100:00100000:3.0:1788833169.838138:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+20:11373:x1875727256454656:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833169.838156:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833169.838185:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff3b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b083 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.838277:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff3bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.838291:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff3bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.838302:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff3bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833169.838313:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788833169.838455:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff3b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b083 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.838474:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff3bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b083 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.838483:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833169.838498:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833169.838501:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd200, rc 0) 00000100:00100000:3.0:1788833169.838584:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+22:11373:x1875727256454656:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 446us (804us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788833169.838590:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 146 00000100:00100000:0.0:1788833169.842854:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833169.842936:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833169.843007:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256454784 00000100:00100000:1.0:1788833169.843026:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256454784 00000100:00100000:1.0:1788833169.843120:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:1.0:1788833169.843130:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+22:2359:x1875727256454784:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833169.843143:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833169.843177:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff3bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b083 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.843215:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:1.0:1788833169.843220:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833169.843268:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:2359:x1875727256454784:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 139us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.843275:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1788833169.843760:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256455040 00000100:00100000:3.0:1788833169.843766:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256455040 00000100:00100000:3.0:1788833169.843808:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 147 00000100:00100000:3.0:1788833169.843816:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+21:11373:x1875727256455040:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833169.843834:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833169.843850:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff3cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b08a expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.843935:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff3d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.843948:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.843958:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833169.843969:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788833169.844266:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff3cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b08a expref: 24 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.844285:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b08a expref: 23 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.844305:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833169.844308:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788833169.844310:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:3.0:1788833169.844355:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+23:11373:x1875727256455040:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 540us (1418us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788833169.844361:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 147 00000100:00100000:0.0:1788833169.856786:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.857506:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256455168 00000100:00100000:3.0:1788833169.857517:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256455168 00000100:00100000:3.0:1788833169.857594:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:3.0:1788833169.857603:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256455168:12345-192.168.206.55@tcp:1:lfs.0 00010000:00010000:3.0:1788833169.857644:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.857664:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.857673:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833169.857678:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833169.857683:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.857715:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.857728:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 6 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833169.857756:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1875727265897856:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833169.857847:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce90207e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833169.865102:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1875727265897856:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833169.865146:0:6654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833169.871900:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.874125:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256455296 00000100:00100000:3.0:1788833169.874140:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256455296 00002000:00100000:3.0:1788833169.874196:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cea066cd500 x1875727256455296/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:355/0 lens 504/0 e 0 to 0 dl 1788833180 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833169.874207:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea066cd500 with x1875727256455296 ext(0->12) 00010000:00010000:3.0:1788833169.874216:0:6661:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 7 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.874231:0:6661:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 7 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833169.874238:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cea066cd500 00000100:00100000:3.0:1788833169.874279:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:3.0:1788833169.874288:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2359:x1875727256455296:12345-192.168.206.55@tcp:4:lfs.0 00000100:00100000:2.0:1788833169.875621:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2359:x1875727256455296:12345-192.168.206.55@tcp:4:lfs.0 Request processed in 1327us (3723us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788833169.875632:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00002000:00100000:2.0:1788833169.875641:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cea066cd500 x1875727256455296/t4294967305(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:355/0 lens 504/448 e 0 to 0 dl 1788833180 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788833169.875651:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea066cd500 with x1875727256455296 ext(0->12) 00010000:00010000:2.0:1788833169.875661:0:6661:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 9 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.875677:0:6661:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 9 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788833169.875684:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cea066cd500 00000100:00100000:3.0:1788833169.882868:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833169.887997:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256455424 00000100:00100000:1.0:1788833169.888013:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256455424 00010000:00010000:1.0:1788833169.888081:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 9 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833169.888119:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:1.0:1788833169.888129:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2360:x1875727256455424:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833169.888144:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788833169.888165:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788833169.888168:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788833169 00002000:00010000:1.0:1788833169.888170:0:5797:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788833169 00002000:00010000:1.0:1788833169.888172:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788833169 00010000:00010000:1.0:1788833169.888178:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 9 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.888191:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 9 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.888215:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba8de30a/0x8c08e876ed3ff395 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b06e expref: 9 pid: 8426 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.888252:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833169.888256:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833169.888261:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.888270:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.890199:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833169.890287:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2360:x1875727256455424:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 2153us (7421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.890298:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 63 00010000:00010000:3.0:1788833169.892103:0:6654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892155:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892200:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892209:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892218:0:6654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892226:0:6654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833169.892231:0:6654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892240:0:6654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892258:0:6654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.892266:0:6654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d674422e/0x8c08e876ed3ff3e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833169.892497:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256455168:12345-192.168.206.55@tcp:1:lfs.0 Request processed in 34889us (35714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833169.892507:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:3.0:1788833169.913227:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833169.921392:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256455680 00000100:00100000:1.0:1788833169.921407:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256455680 00000100:00100000:0.0:1788833169.921558:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:0.0:1788833169.921571:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+23:11373:x1875727256455680:12345-192.168.206.55@tcp:35:lfs.0 00000004:00010000:0.0:1788833169.921630:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b08a expref: 23 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833169.921875:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788833169.921919:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788833169.922438:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1788833169.922495:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.922511:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.922519:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.922570:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833169.922585:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 27 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833169.922600:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265897984:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833169.922694:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1264c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833169.929584:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833169.929649:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256455808 00000100:00100000:1.0:1788833169.929658:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256455808 00010000:00010000:1.0:1788833169.929699:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 28 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833169.929749:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:1.0:1788833169.929759:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+28:2358:x1875727256455808:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833169.929776:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833169.929783:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 28 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.929796:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 28 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.929838:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:1.0:1788833169.929843:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.929852:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.929860:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833169.929879:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833169.929937:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+28:2358:x1875727256455808:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 180us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833169.929944:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 64 00010000:00010000:3.0:1788833169.933635:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b060 expref: 27 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833169.933663:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea066cfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265897984:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833169.933691:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.933816:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.933823:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833169.933955:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788833169.934189:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788833169.934295:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265898112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788833169.934353:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833169.934403:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833169.935135:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265898112 00000100:00100000:0.0:1788833169.935146:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265898112 00000100:00100000:0.0:1788833169.935209:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788833169.935218:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265898112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788833169.935328:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265898112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833169.935336:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788833169.936151:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265898112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788833169.936836:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788833169.936908:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265898240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788833169.936952:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833169.936974:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce90207eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833169.937991:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265898240 00000100:00100000:0.0:1788833169.938001:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265898240 00000100:00100000:0.0:1788833169.938094:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788833169.938103:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5815:x1875727265898240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788833169.938324:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1875727265898240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (1369us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788833169.938331:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788833169.938657:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265898240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788833169.938724:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788833169.938768:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.938779:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.938786:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.938803:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833169.938807:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.938815:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.938831:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833169.938834:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788833169.938839:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833169.938844:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff3e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788833169.939021:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788833169.939154:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788833169.939165:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304005133209ns, next at 305005131232ns, rc = 0 00000001:00080000:3.0:1788833169.939172:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788833169.939202:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833169.939205:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788833169.939212:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff3d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b08a expref: 31 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833169.939312:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+30:11373:x1875727256455680:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 17744us (26096us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788833169.939320:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00000020:00080000:3.0:1788833169.939324:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788833169.947278:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833169.947390:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256455936 00000100:00100000:2.0:1788833169.947400:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256455936 00000100:00100000:2.0:1788833169.947461:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 148 00000100:00100000:2.0:1788833169.947718:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+30:11373:x1875727256455936:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833169.947755:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833169.947779:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff3f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b091 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.947839:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b091 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.947852:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b091 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833169.947879:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833169.947883:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833169.947886:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036e00, rc 0) 00000100:00100000:2.0:1788833169.947942:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+31:11373:x1875727256455936:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 458us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833169.947949:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 148 00000100:00100000:2.0:1788833169.952117:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833169.952202:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256456192 00000100:00100000:3.0:1788833169.952212:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256456192 00000100:00100000:3.0:1788833169.952265:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:3.0:1788833169.952274:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:11373:x1875727256456192:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833169.952506:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11373:x1875727256456192:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 233us (399us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788833169.952513:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:0.0:1788833170.053093:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833170.053185:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256456448 00000100:00100000:1.0:1788833170.053193:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256456448 00000100:00100000:1.0:1788833170.053251:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 149 00000100:00100000:1.0:1788833170.053264:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11383:x1875727256456448:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833170.053288:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833170.053308:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff3f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b098 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833170.053389:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788833170.053499:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff3f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b098 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.053513:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:1.0:1788833170.053547:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788833170.053555:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff3f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b098 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.053569:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02faca00, rc 0) 00000100:00100000:1.0:1788833170.053628:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+33:11383:x1875727256456448:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 368us (545us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1788833170.053636:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 149 00000100:00100000:0.0:1788833170.063512:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833170.063703:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256456576 00000100:00100000:1.0:1788833170.063723:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256456576 00000100:00100000:1.0:1788833170.063783:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 150 00000100:00100000:1.0:1788833170.063794:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+33:11383:x1875727256456576:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:1.0:1788833170.063880:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.063898:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.063909:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.063924:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.063931:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.063938:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064021:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064073:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064080:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788833170.064119:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064130:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064137:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064143:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064148:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02faca00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833170.064152:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064159:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064171:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833170.064174:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833170.064178:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064184:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064203:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064208:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064213:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064217:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833170.064220:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064226:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064234:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea0884e000) 00010000:00010000:1.0:1788833170.064237:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833170.064239:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064244:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff40c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064256:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064273:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064280:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064291:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833170.064294:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064300:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064308:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:1.0:1788833170.064310:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833170.064313:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.064319:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833170.064382:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+33:11383:x1875727256456576:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 590us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833170.064390:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 150 00000100:00100000:2.0:1788833170.068243:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833170.068325:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256456832 00000100:00100000:3.0:1788833170.068334:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256456832 00000100:00100000:3.0:1788833170.068395:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:3.0:1788833170.068405:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+33:11383:x1875727256456832:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833170.068658:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+34:11383:x1875727256456832:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 253us (422us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788833170.068666:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:0.0:1788833170.111283:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833170.111380:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256457088 00000100:00100000:2.0:1788833170.111401:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256457088 00000100:00100000:2.0:1788833170.111458:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 151 00000100:00100000:2.0:1788833170.111468:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea066ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+34:11386:x1875727256457088:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833170.111492:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833170.111510:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff41a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b09f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111618:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111633:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111644:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111657:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111664:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111671:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111796:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111805:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111812:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833170.111822:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788833170.111917:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111925:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111937:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111943:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833170.111948:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111955:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111967:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:2.0:1788833170.111970:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833170.111974:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111980:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111992:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.111999:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112005:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112010:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833170.112014:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112081:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112090:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea1539cc00) 00010000:00010000:2.0:1788833170.112092:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833170.112095:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112100:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112140:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff41a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112153:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.112159:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833170.112161:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833170.112163:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036600, rc 0) 00000100:00100000:2.0:1788833170.112225:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea066ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+36:11386:x1875727256457088:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 758us (950us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788833170.112232:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 151 00000100:00100000:0.0:1788833170.116761:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833170.116844:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256457216 00000100:00100000:3.0:1788833170.116854:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256457216 00000100:00100000:3.0:1788833170.116915:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 152 00000100:00100000:3.0:1788833170.116925:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+36:11386:x1875727256457216:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:3.0:1788833170.116993:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117012:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117024:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117084:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117102:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117108:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117113:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833170.117117:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117124:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117136:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:3.0:1788833170.117139:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833170.117144:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.117150:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff43d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833170.117212:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+36:11386:x1875727256457216:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 288us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833170.117219:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 152 00000100:00100000:0.0:1788833170.119977:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833170.120081:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256457472 00000100:00100000:3.0:1788833170.120091:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256457472 00000100:00100000:3.0:1788833170.120143:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:3.0:1788833170.120153:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+36:11386:x1875727256457472:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833170.120364:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+37:11386:x1875727256457472:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 212us (394us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788833170.120395:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 41 00010000:00010000:3.0:1788833170.413357:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833170.433936:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833170.434026:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256457728 00000100:00100000:3.0:1788833170.434060:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256457728 00000100:00100000:3.0:1788833170.434119:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 153 00000100:00100000:3.0:1788833170.434129:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+37:11417:x1875727256457728:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:3.0:1788833170.434152:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833170.434173:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0a6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.434281:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff44b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.434294:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.434306:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833170.434316:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788833170.434439:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0a6 expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.434457:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff44b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0a6 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.434466:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:3.0:1788833170.434469:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833170.434486:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516c00, rc 0) 00000100:00100000:3.0:1788833170.434557:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11417:x1875727256457728:12345-192.168.206.55@tcp:101:cat.0 Request processed in 429us (630us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788833170.434565:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 153 00000100:00100000:0.0:1788833170.439717:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833170.439846:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256457856 00000100:00100000:2.0:1788833170.439855:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256457856 00000100:00100000:2.0:1788833170.439913:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:2.0:1788833170.439921:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+39:2359:x1875727256457856:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833170.439950:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833170.439973:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff44b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0a6 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.439992:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833170.439996:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833170.440074:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+38:2359:x1875727256457856:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 153us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833170.440081:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:0.0:1788833170.440519:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833170.440864:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256458112 00000100:00100000:3.0:1788833170.440869:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256458112 00000100:00100000:3.0:1788833170.440907:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:3.0:1788833170.440914:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+38:11417:x1875727256458112:12345-192.168.206.55@tcp:35:cat.0 00000100:00100000:3.0:1788833170.441131:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11417:x1875727256458112:12345-192.168.206.55@tcp:35:cat.0 Request processed in 217us (612us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788833170.441137:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:0.0:1788833170.528828:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833170.530199:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256458368 00000100:00100000:1.0:1788833170.530212:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256458368 00000100:00100000:1.0:1788833170.530292:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 154 00000100:00100000:1.0:1788833170.530302:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11423:x1875727256458368:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:1.0:1788833170.530326:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833170.530328:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788833170.530352:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff3b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b07c expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.530370:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833170.530388:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833170.530404:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff459 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.530497:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.530511:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.530518:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.530569:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.530582:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 39 pid: 5813 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833170.530594:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265898368:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833170.530691:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea033933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833170.536398:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833170.536484:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256458496 00000100:00100000:2.0:1788833170.536493:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256458496 00010000:00010000:2.0:1788833170.536532:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 40 pid: 5813 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833170.536590:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:2.0:1788833170.536600:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+40:2358:x1875727256458496:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833170.536612:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833170.536619:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 40 pid: 5813 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.536633:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 40 pid: 5813 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.536655:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833170.536661:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.536687:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.536695:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.536843:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833170.536898:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+40:2358:x1875727256458496:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 299us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833170.536906:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 65 00010000:00010000:1.0:1788833170.536992:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff42f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b09f expref: 39 pid: 5813 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833170.537008:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265898368:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833170.537063:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.537073:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.537086:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833170.537104:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788833170.537242:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff459 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 40 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.537257:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.537265:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:1.0:1788833170.537267:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833170.537270:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fad800, rc 0) 00000100:00100000:1.0:1788833170.537295:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11423:x1875727256458368:12345-192.168.206.55@tcp:101:dd.0 Request processed in 6995us (8477us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788833170.537302:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 154 00000100:00100000:0.0:1788833170.541787:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833170.542132:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256458752 00000100:00100000:1.0:1788833170.542142:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256458752 00000100:00100000:1.0:1788833170.542202:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 155 00000100:00100000:1.0:1788833170.542212:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11423:x1875727256458752:12345-192.168.206.55@tcp:36:dd.0 00010000:00010000:1.0:1788833170.542589:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.542605:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.542617:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788833170.542682:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1788833170.542708:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eef2e7c2 reply state 00000000eb751972 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833170.542718:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833170.542803:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+42:11423:x1875727256458752:12345-192.168.206.55@tcp:36:dd.0 Request processed in 592us (1024us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788833170.542810:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 155 00000020:00080000:1.0:1788833170.542815:0:8616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788833170.548839:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.548856:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.548863:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.548868:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02faca00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833170.548872:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.548879:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.548894:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833170.548897:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833170.548902:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.548924:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff46e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833170.862012:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833170.862023:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833170.862333:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788833170.862340:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788833170.882430:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833170.882528:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256458880 00000100:00100000:2.0:1788833170.882548:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256458880 00000100:00100000:2.0:1788833170.882655:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 156 00000100:00100000:2.0:1788833170.882669:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+41:11437:x1875727256458880:12345-192.168.206.55@tcp:101:stat.0 00010000:00010000:2.0:1788833170.882692:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833170.882714:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0b4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882792:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882807:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882818:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882846:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882853:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882859:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882940:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882962:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.882971:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.883003:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.883016:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 42 pid: 5812 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833170.883028:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265898496:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833170.883162:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788833170.886418:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265898496:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833170.886447:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833170.889899:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833170.890159:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256459136 00000100:00100000:3.0:1788833170.890172:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256459136 00000100:00100000:3.0:1788833170.890246:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:3.0:1788833170.890259:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+43:6056:x1875727256459136:12345-192.168.206.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788833170.891404:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+44:6056:x1875727256459136:12345-192.168.206.55@tcp:35:ldlm_bl.0 Request processed in 1139us (1512us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788833170.891416:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:0.0:1788833170.893460:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833170.893747:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256459264 00000100:00100000:2.0:1788833170.893760:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256459264 00010000:00010000:2.0:1788833170.893810:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 44 pid: 5812 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833170.893859:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 66 00000100:00100000:2.0:1788833170.893869:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+44:2358:x1875727256459264:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833170.893882:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833170.893901:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 44 pid: 5812 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.893915:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 44 pid: 5812 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.893937:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff460 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ad expref: 44 pid: 5812 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.893953:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833170.893958:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.893967:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.893974:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833170.894012:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833170.894128:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+43:2358:x1875727256459264:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 253us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833170.894136:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 66 00010000:00010000:3.0:1788833170.895992:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896006:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833170.896093:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788833170.896097:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833170.896117:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896160:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896170:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896176:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896183:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896189:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833170.896192:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896200:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896213:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:3.0:1788833170.896217:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833170.896221:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896227:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff47c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896243:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896249:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896260:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896265:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833170.896268:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896273:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896281:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea1539cc00) 00010000:00010000:3.0:1788833170.896283:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833170.896286:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896291:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896331:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0b4 expref: 43 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896345:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0b4 expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.896351:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:3.0:1788833170.896353:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833170.896356:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036c00, rc 0) 00000100:00100000:3.0:1788833170.896406:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+42:11437:x1875727256458880:12345-192.168.206.55@tcp:101:stat.0 Request processed in 13741us (13988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833170.896422:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 156 00000100:00100000:0.0:1788833170.960996:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833170.961159:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256459520 00000100:00100000:1.0:1788833170.961169:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256459520 00000100:00100000:1.0:1788833170.961238:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 157 00000100:00100000:1.0:1788833170.961249:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+42:11443:x1875727256459520:12345-192.168.206.55@tcp:36:truncate.0 00010000:00010000:1.0:1788833170.961313:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833170.961354:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff48a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0b4 expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.961373:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:1.0:1788833170.961378:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833170.961633:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.961960:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833170.961990:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788833170.962089:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1788833170.962115:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a0c900b reply state 000000004fc73c67 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833170.962124:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833170.962423:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+44:11443:x1875727256459520:12345-192.168.206.55@tcp:36:truncate.0 Request processed in 1174us (1432us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788833170.962432:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 157 00000020:00080000:1.0:1788833170.962438:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788833170.991747:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.991919:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.991929:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.991935:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833170.991941:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.991949:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.991967:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:3.0:1788833170.991970:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833170.991975:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833170.991980:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833171.138083:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.138228:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256459648 00000100:00100000:1.0:1788833171.138241:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256459648 00000100:00100000:1.0:1788833171.138365:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 158 00000100:00100000:1.0:1788833171.138380:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+43:11457:x1875727256459648:12345-192.168.206.55@tcp:101:stat.0 00010000:00010000:1.0:1788833171.138423:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833171.138450:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0bb expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.138562:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.138580:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.138595:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.138638:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.138647:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.138654:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139080:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139090:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139098:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833171.139138:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788833171.139143:0:8616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833171.139168:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139181:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139190:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139196:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139214:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139220:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fade00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833171.139224:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139232:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139246:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833171.139249:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833171.139254:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139261:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff49f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139274:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139280:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139285:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139290:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833171.139292:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139306:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139315:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea0884e000) 00010000:00010000:1.0:1788833171.139317:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833171.139320:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139326:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139367:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 45 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788833171.139595:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788833171.139641:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 44 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.139651:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:1.0:1788833171.139653:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833171.139656:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fada00, rc 0) 00000100:00100000:1.0:1788833171.139800:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+44:11457:x1875727256459648:12345-192.168.206.55@tcp:101:stat.0 Request processed in 1423us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833171.139809:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 158 00000100:00100000:0.0:1788833171.250226:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.250344:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256459904 00000100:00100000:3.0:1788833171.250357:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256459904 00000100:00100000:3.0:1788833171.250605:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 159 00000100:00100000:3.0:1788833171.250619:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+44:11467:x1875727256459904:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833171.250646:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833171.250690:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff4b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0c2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833171.250838:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788833171.251005:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff4b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c2 expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.251022:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:3.0:1788833171.251026:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833171.251075:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff4b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c2 expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.251092:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:3.0:1788833171.251171:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+45:11467:x1875727256459904:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 556us (960us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1788833171.251179:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 159 00000100:00100000:2.0:1788833171.255614:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.255800:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256460160 00000100:00100000:1.0:1788833171.255813:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256460160 00000100:00100000:1.0:1788833171.255929:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:1.0:1788833171.255943:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+45:11467:x1875727256460160:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:1.0:1788833171.256464:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+46:11467:x1875727256460160:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 522us (863us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788833171.256473:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:0.0:1788833171.354924:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.355413:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256460416 00000100:00100000:1.0:1788833171.355519:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256460416 00000100:00100000:1.0:1788833171.355679:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 160 00000100:00100000:1.0:1788833171.355693:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+46:11473:x1875727256460416:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1788833171.355725:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833171.355753:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff4c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.355885:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.355903:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 47 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.355914:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.355956:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 47 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.355971:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 47 pid: 8616 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833171.355987:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265898624:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833171.356316:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea033933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833171.359970:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833171.360071:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256460544 00000100:00100000:2.0:1788833171.360084:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256460544 00010000:00010000:2.0:1788833171.360148:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 48 pid: 8616 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833171.360204:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 67 00000100:00100000:2.0:1788833171.360243:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+48:2358:x1875727256460544:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833171.360264:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833171.360272:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 48 pid: 8616 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.360288:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 48 pid: 8616 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.360316:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833171.360323:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.360334:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.360343:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.360366:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833171.360458:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+48:2358:x1875727256460544:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 217us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833171.360467:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 67 00010000:00010000:1.0:1788833171.360698:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff4ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0bb expref: 48 pid: 8616 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833171.360721:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265898624:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833171.360882:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.360896:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.360903:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833171.360926:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788833171.361364:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff4c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.361384:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.361393:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:1.0:1788833171.361396:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833171.361400:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fac600, rc 0) 00000100:00100000:1.0:1788833171.361472:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+48:11473:x1875727256460416:12345-192.168.206.55@tcp:101:bash.0 Request processed in 5782us (6564us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788833171.361480:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 160 00000100:00100000:0.0:1788833171.364005:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.364303:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256460800 00000100:00100000:1.0:1788833171.364334:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256460800 00000100:00100000:1.0:1788833171.364523:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 161 00000100:00100000:1.0:1788833171.364547:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+47:11473:x1875727256460800:12345-192.168.206.55@tcp:36:bash.0 00010000:00010000:1.0:1788833171.364893:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.364916:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.364929:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788833171.364993:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1788833171.365023:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072d29d6b reply state 000000008425b323 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833171.365063:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833171.365201:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+50:11473:x1875727256460800:12345-192.168.206.55@tcp:36:bash.0 Request processed in 665us (1209us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788833171.365218:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 161 00000020:00080000:1.0:1788833171.365225:0:8616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788833171.368308:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.368334:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.368343:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.368371:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fade00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833171.368386:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.368396:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.368417:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833171.368420:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833171.368426:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.368432:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff4d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833171.373987:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.374404:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256460928 00000100:00100000:3.0:1788833171.374419:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256460928 00000100:00100000:3.0:1788833171.374511:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 162 00000100:00100000:3.0:1788833171.374525:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+49:11473:x1875727256460928:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833171.374564:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833171.374593:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff4de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0d0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.374742:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.374759:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.374776:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.374818:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.374833:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 50 pid: 5812 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833171.374848:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1fd5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265898752:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833171.374958:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce90207e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788833171.378831:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.380049:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256461056 00000100:00100000:0.0:1788833171.380068:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256461056 00000100:00100000:2.0:1788833171.380202:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1fd5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265898752:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833171.380239:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 51 pid: 5812 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.380244:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833171.380645:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:0.0:1788833171.380662:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+51:2357:x1875727256461056:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833171.380681:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833171.380703:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 51 pid: 5812 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.380718:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 51 pid: 5812 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.380740:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff4c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0c9 expref: 51 pid: 5812 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.380758:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:0.0:1788833171.380763:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.380772:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.380779:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.380809:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833171.380871:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+50:2357:x1875727256461056:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 216us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833171.380879:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 68 00010000:00010000:2.0:1788833171.381292:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.381306:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833171.381372:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788833171.381391:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833171.381420:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.382101:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff4de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0d0 expref: 50 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.382152:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0d0 expref: 49 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.382164:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833171.382168:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833171.382171:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516000, rc 0) 00000100:00100000:2.0:1788833171.382251:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+49:11473:x1875727256460928:12345-192.168.206.55@tcp:101:bash.0 Request processed in 7729us (8278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833171.382261:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 162 00000100:00100000:3.0:1788833171.386816:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833171.387371:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256461312 00000100:00100000:2.0:1788833171.387680:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256461312 00000100:00100000:2.0:1788833171.387809:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:2.0:1788833171.387824:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+49:11473:x1875727256461312:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:2.0:1788833171.388189:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+50:11473:x1875727256461312:12345-192.168.206.55@tcp:35:bash.0 Request processed in 367us (1387us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788833171.388198:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 45 00010000:00010000:3.0:1788833171.442499:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833171.507797:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.507948:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256461568 00000100:00100000:3.0:1788833171.507961:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256461568 00000100:00100000:3.0:1788833171.508138:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 163 00000100:00100000:3.0:1788833171.508153:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+50:11483:x1875727256461568:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833171.508186:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833171.508218:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff4ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0d7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833171.508350:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788833171.508670:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff4ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0d7 expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.508719:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:3.0:1788833171.508723:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833171.508729:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff4ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0d7 expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.508746:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517400, rc 0) 00000100:00100000:3.0:1788833171.508823:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+51:11483:x1875727256461568:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 672us (1046us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1788833171.508831:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 163 00000100:00100000:0.0:1788833171.512343:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.513351:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256461696 00000100:00100000:1.0:1788833171.513366:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256461696 00000100:00100000:1.0:1788833171.513650:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 164 00000100:00100000:1.0:1788833171.513662:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+51:11483:x1875727256461696:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:1.0:1788833171.513768:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.513790:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.513827:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.513847:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.513855:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.513861:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.513990:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514000:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514007:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788833171.514112:0:8616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514130:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514137:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514144:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514161:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833171.514166:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514174:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514188:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833171.514191:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833171.514196:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514203:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff4fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514218:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514224:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514229:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514235:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833171.514237:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514243:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514260:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea0884e000) 00010000:00010000:1.0:1788833171.514262:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833171.514265:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514271:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514286:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514292:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514297:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514302:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fada00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833171.514305:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514311:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514318:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:1.0:1788833171.514320:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833171.514323:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.514329:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fada00/0x8c08e876ed3ff508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833171.515704:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+51:11483:x1875727256461696:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 2029us (3359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833171.515721:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 164 00000100:00100000:0.0:1788833171.531706:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.531792:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256461952 00000100:00100000:1.0:1788833171.531804:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256461952 00000100:00100000:1.0:1788833171.531875:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:1.0:1788833171.531887:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+51:11483:x1875727256461952:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:1.0:1788833171.532233:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+52:11483:x1875727256461952:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 346us (538us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788833171.532243:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:2.0:1788833171.598444:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.598510:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256462208 00000100:00100000:3.0:1788833171.598524:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256462208 00000100:00100000:3.0:1788833171.598678:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 165 00000100:00100000:3.0:1788833171.598691:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+52:11486:x1875727256462208:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833171.598916:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833171.598947:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff50f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0de expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599104:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599123:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599136:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599154:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599180:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599186:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599333:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599342:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599350:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833171.599361:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788833171.599494:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599503:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599510:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599517:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.599522:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.599530:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600335:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:3.0:1788833171.600344:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833171.600351:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600360:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600629:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600638:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600645:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600651:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.600654:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600661:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600669:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833171.600672:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833171.600675:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.600680:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff51d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.605076:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff50f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0de expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.605116:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0de expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.605127:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833171.605130:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833171.605155:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dca00, rc 0) 00000100:00100000:2.0:1788833171.605242:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11486:x1875727256462208:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 6553us (6811us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788833171.605251:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 165 00000100:00100000:0.0:1788833171.612274:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.612337:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.612472:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256462464 00000100:00100000:3.0:1788833171.612492:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256462464 00000100:00100000:3.0:1788833171.612575:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 166 00000100:00100000:3.0:1788833171.612587:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11486:x1875727256462464:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:3.0:1788833171.612682:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612703:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612717:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612751:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612758:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612765:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612771:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.612776:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612783:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612796:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:3.0:1788833171.612816:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833171.612822:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.612829:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833171.612923:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11486:x1875727256462464:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 338us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833171.612931:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 166 00000100:00100000:1.0:1788833171.614309:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256462336 00000100:00100000:1.0:1788833171.614325:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256462336 00000100:00100000:1.0:1788833171.614763:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:1.0:1788833171.614775:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+54:2359:x1875727256462336:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833171.614799:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833171.614833:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0de expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.614859:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:1.0:1788833171.614865:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833171.614945:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+53:2359:x1875727256462336:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 172us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833171.614953:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:3.0:1788833171.616015:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.616166:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256462720 00000100:00100000:0.0:1788833171.616175:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256462720 00000100:00100000:0.0:1788833171.616230:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:0.0:1788833171.616256:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+53:11486:x1875727256462720:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833171.616565:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11486:x1875727256462720:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 310us (553us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788833171.616574:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:0.0:1788833171.788547:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.788895:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256462976 00000100:00100000:1.0:1788833171.788921:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256462976 00000100:00100000:2.0:1788833171.789078:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 167 00000100:00100000:2.0:1788833171.789095:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11504:x1875727256462976:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:2.0:1788833171.789132:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833171.789168:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0e5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.789314:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.789333:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.789348:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833171.789361:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788833171.789617:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0e5 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.789640:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0e5 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.789650:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:2.0:1788833171.789653:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788833171.789657:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036400, rc 0) 00000100:00100000:2.0:1788833171.789774:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11504:x1875727256462976:12345-192.168.206.55@tcp:101:cat.0 Request processed in 684us (1256us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788833171.789782:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 167 00000100:00100000:2.0:1788833171.826768:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.826886:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256463104 00000100:00100000:0.0:1788833171.826907:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256463104 00000100:00100000:0.0:1788833171.827001:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 168 00000100:00100000:0.0:1788833171.827015:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11505:x1875727256463104:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833171.827123:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833171.827154:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0ec expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.827262:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.827281:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.827297:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833171.827347:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788833171.827351:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833171.827372:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.827405:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ec expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.827456:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ec expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.827466:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833171.827470:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833171.827474:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925aa00, rc 0) 00000100:00100000:0.0:1788833171.827581:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11505:x1875727256463104:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 569us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833171.827590:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 168 00000100:00100000:3.0:1788833171.833280:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.833399:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256463488 00000100:00100000:0.0:1788833171.833411:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256463488 00000100:00100000:0.0:1788833171.833516:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:0.0:1788833171.833529:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11505:x1875727256463488:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833171.834098:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11505:x1875727256463488:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 568us (828us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788833171.834108:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:1.0:1788833171.836890:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.837685:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256463616 00000100:00100000:3.0:1788833171.837700:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256463616 00000100:00100000:3.0:1788833171.837917:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:3.0:1788833171.837930:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11505:x1875727256463616:12345-192.168.206.55@tcp:103:lfs.0 00010000:00010000:3.0:1788833171.837949:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788833171.838145:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff4e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0d0 expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.838176:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0e5 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.838192:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff3f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b091 expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.838204:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539cd00) 00010000:00010000:3.0:1788833171.838218:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833171.838318:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11505:x1875727256463616:12345-192.168.206.55@tcp:103:lfs.0 Request processed in 391us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833171.838327:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:2.0:1788833171.841433:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.841669:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256463744 00000100:00100000:3.0:1788833171.841683:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256463744 00000100:00100000:3.0:1788833171.841754:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 169 00000100:00100000:3.0:1788833171.841766:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11505:x1875727256463744:12345-192.168.206.55@tcp:58:lfs.0 00010000:00010000:3.0:1788833171.842251:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.842275:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.842290:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788833171.842717:0:11926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788833171.843239:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11505:x1875727256463744:12345-192.168.206.55@tcp:58:lfs.0 Request processed in 1469us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833171.843252:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 169 00000100:00100000:2.0:1788833171.874358:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.874610:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256463872 00000100:00100000:3.0:1788833171.874624:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256463872 00000100:00100000:3.0:1788833171.874703:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 170 00000100:00100000:3.0:1788833171.874716:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11507:x1875727256463872:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833171.874746:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833171.874775:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0f3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875028:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875116:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875131:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875151:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875160:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875167:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875281:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875290:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875297:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833171.875339:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788833171.875345:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833171.875367:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875380:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875399:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875406:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875424:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875430:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.875435:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875443:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875458:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:3.0:1788833171.875461:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833171.875465:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.875472:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff56a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876118:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876127:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876135:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876154:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dca00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.876158:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876165:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876178:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea32de4a00) 00010000:00010000:3.0:1788833171.876181:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833171.876184:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876190:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876239:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876258:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.876265:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833171.876268:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833171.876271:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516000, rc 0) 00000100:00100000:2.0:1788833171.879124:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11507:x1875727256463872:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 4390us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833171.879143:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 170 00000040:00080000:1.0:1788833171.885286:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833171.885299:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833171.885345:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788833171.885354:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788833171.885559:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265898880:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788833171.885695:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833171.889279:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3f5a8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265898880:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788833171.897972:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.898374:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256464000 00000100:00100000:1.0:1788833171.898389:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256464000 00000100:00100000:1.0:1788833171.898479:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 171 00000100:00100000:1.0:1788833171.898492:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11509:x1875727256464000:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788833171.898547:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788833171.898692:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11509:x1875727256464000:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 202us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833171.898700:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 171 00000100:00100000:2.0:1788833171.905212:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.905347:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256464128 00000100:00100000:3.0:1788833171.905360:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256464128 00000100:00100000:3.0:1788833171.905676:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 172 00000100:00100000:3.0:1788833171.905692:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11509:x1875727256464128:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788833171.905835:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905854:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905867:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905885:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905892:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905897:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905937:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905945:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.905951:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833171.906008:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788833171.906012:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833171.906068:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906082:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906095:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906103:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906111:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.906117:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906125:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906139:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:3.0:1788833171.906143:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833171.906148:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906155:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff57f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906173:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906177:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906183:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906187:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.906196:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906203:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906212:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9cea32de4a00) 00010000:00010000:3.0:1788833171.906214:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833171.906217:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906223:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff586 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906238:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906244:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906251:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906256:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.906260:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906266:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906272:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833171.906274:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833171.906283:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.906288:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff58d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833171.906397:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11509:x1875727256464128:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 Request processed in 708us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833171.906406:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 172 00000100:00100000:2.0:1788833171.910651:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.910756:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256464384 00000100:00100000:0.0:1788833171.910768:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256464384 00000100:00100000:0.0:1788833171.911297:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 173 00000100:00100000:0.0:1788833171.911313:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+56:11509:x1875727256464384:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833171.911340:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833171.911367:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff594 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b0fa expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911547:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911583:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911597:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833171.911612:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788833171.911739:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911747:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911754:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911759:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833171.911764:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911771:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911785:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:0.0:1788833171.911788:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833171.911793:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.911800:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff59b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.912196:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff594 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0fa expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.912219:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:0.0:1788833171.912221:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833171.912226:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff594 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0fa expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.912237:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a600, rc 0) 00000100:00100000:0.0:1788833171.912327:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11509:x1875727256464384:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 1020us (1691us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1788833171.912336:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 173 00000100:00100000:2.0:1788833171.917629:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.917726:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256464512 00000100:00100000:0.0:1788833171.917740:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256464512 00000100:00100000:0.0:1788833171.917822:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 174 00000100:00100000:0.0:1788833171.917835:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11509:x1875727256464512:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788833171.917880:0:8616:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788833171.918071:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11509:x1875727256464512:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 201us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833171.918081:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 174 00000100:00100000:2.0:1788833171.921127:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.921225:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256464768 00000100:00100000:0.0:1788833171.921238:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256464768 00000100:00100000:0.0:1788833171.921301:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 175 00000100:00100000:0.0:1788833171.921312:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11509:x1875727256464768:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833171.921336:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833171.921340:0:11926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788833171.921371:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0ec expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.921427:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833171.921433:0:11926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833171.921451:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff5a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b101 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788833171.921971:0:11926:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788833171.922241:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.922258:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.922270:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.922338:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff5a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b101 expref: 59 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.922356:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b101 expref: 58 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.922365:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833171.922368:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833171.922370:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a000, rc 0) 00000100:00100000:0.0:1788833171.922456:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11509:x1875727256464768:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 1145us (1342us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788833171.922464:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 175 00000100:00100000:1.0:1788833171.925864:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.926238:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256465024 00000100:00100000:0.0:1788833171.926252:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256465024 00000100:00100000:0.0:1788833171.926319:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 176 00000100:00100000:0.0:1788833171.926331:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11509:x1875727256465024:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788833171.926492:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833171.926529:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b101 expref: 58 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.926562:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833171.926576:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833171.926605:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.926620:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.926633:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.926779:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.926790:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.926798:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927229:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927263:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927271:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927278:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833171.927283:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927292:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927304:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833171.927308:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833171.927313:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927320:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927334:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927341:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927347:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927352:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833171.927362:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927369:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927378:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfe6e2690 (ffff9cea08db1a00) 00010000:00010000:0.0:1788833171.927380:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833171.927383:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.927389:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe6e2690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833171.928268:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11509:x1875727256465024:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 1931us (2412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788833171.928280:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 176 00000100:00100000:3.0:1788833171.933878:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833171.935144:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256465152 00000100:00100000:2.0:1788833171.935161:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256465152 00000100:00100000:2.0:1788833171.935338:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 177 00000100:00100000:2.0:1788833171.935351:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11509:x1875727256465152:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833171.935391:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833171.935423:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff5cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b108 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.935471:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.935498:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.935514:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.935668:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff5cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 59 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.935689:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833171.936229:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:2.0:1788833171.936233:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788833171.936238:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037800, rc 0) 00000100:00100000:2.0:1788833171.936344:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11509:x1875727256465152:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 994us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833171.936352:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 177 00000100:00100000:2.0:1788833171.943635:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.948555:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256465408 00000100:00100000:1.0:1788833171.948576:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256465408 00000100:00100000:1.0:1788833171.949012:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 178 00000100:00100000:1.0:1788833171.949027:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11509:x1875727256465408:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788833171.949382:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.949404:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.949420:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833171.950583:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788833171.950604:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306016572674ns, next at 307016568064ns, rc = 0 00000004:00010000:1.0:1788833171.952019:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000694badf6 reply state 000000001963e4bc transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833171.952054:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833171.952487:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11509:x1875727256465408:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 3457us (8860us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788833171.952498:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 178 00010000:00010000:3.0:1788833171.955086:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.955105:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.955114:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.955121:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fade00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833171.955128:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.955137:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.955156:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:3.0:1788833171.955159:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788833171.955163:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833171.955169:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff5da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833171.955656:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.955957:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256465536 00000100:00100000:0.0:1788833171.955974:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256465536 00000100:00100000:0.0:1788833171.956077:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 179 00000100:00100000:0.0:1788833171.956103:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0392b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+59:11509:x1875727256465536:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833171.956137:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833171.956166:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b10f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.956250:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.956267:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.956319:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:0.0:1788833171.956323:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833171.956327:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a800, rc 0) 00000100:00100000:0.0:1788833171.956408:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0392b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11509:x1875727256465536:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 320us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833171.956416:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 179 00000100:00100000:2.0:1788833171.959166:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833171.959415:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256465664 00000100:00100000:3.0:1788833171.959424:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256465664 00000100:00100000:3.0:1788833171.959497:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:3.0:1788833171.959508:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256465664:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788833171.959930:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833171.959979:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256465664:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 469us (818us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788833171.959991:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:3.0:1788833171.963213:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833171.964275:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256465920 00000100:00100000:2.0:1788833171.964288:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256465920 00000100:00100000:2.0:1788833171.964348:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:2.0:1788833171.964359:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11509:x1875727256465920:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788833171.965435:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11509:x1875727256465920:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 1073us (2224us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788833171.965446:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:1.0:1788833171.972151:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833171.972257:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256466176 00000100:00100000:2.0:1788833171.972268:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256466176 00000100:00100000:2.0:1788833171.972327:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 180 00000100:00100000:2.0:1788833171.972339:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11509:x1875727256466176:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833171.972468:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11509:x1875727256466176:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 129us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833171.972476:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 180 00000100:00100000:1.0:1788833171.989017:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833171.993009:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256466304 00000100:00100000:0.0:1788833171.993023:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256466304 00000100:00100000:0.0:1788833171.993118:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 181 00000100:00100000:0.0:1788833171.993128:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11509:x1875727256466304:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833171.993148:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833171.993166:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b116 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.993244:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.993257:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.993269:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833171.993301:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833171.993317:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.993350:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff5e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b116 expref: 63 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.993365:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b116 expref: 62 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833171.993373:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:0.0:1788833171.993375:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788833171.993379:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a000, rc 0) 00000100:00100000:0.0:1788833171.993454:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11509:x1875727256466304:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 328us (4445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833171.993461:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 181 00000100:00100000:2.0:1788833171.999415:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833171.999491:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256466432 00000100:00100000:1.0:1788833171.999501:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256466432 00000100:00100000:1.0:1788833171.999569:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:1.0:1788833171.999580:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256466432:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833171.999598:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833171.999618:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b11d expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833171.999646:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6d93, blocks: 0x1 00010000:00010000:1.0:1788833171.999665:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=306s v=(0 0) 00010000:00010000:1.0:1788833171.999670:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833171.999679:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 8 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.999698:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 8 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833171.999721:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02faca00, rc 0) 00000100:00100000:1.0:1788833171.999779:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256466432:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 200us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833171.999785:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:0.0:1788833172.007843:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.007941:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256466688 00000100:00100000:2.0:1788833172.007961:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256466688 00000100:00100000:2.0:1788833172.008021:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 182 00000100:00100000:2.0:1788833172.008054:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11509:x1875727256466688:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833172.008514:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11509:x1875727256466688:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 483us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833172.008522:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 182 00000100:00100000:0.0:1788833172.012271:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.012362:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256466816 00000100:00100000:2.0:1788833172.012372:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256466816 00000100:00100000:2.0:1788833172.012431:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:2.0:1788833172.012440:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+8:11509:x1875727256466816:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833172.012455:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833172.012471:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b124 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.012501:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 9 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.012510:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833172.012515:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833172.012520:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.012573:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 9 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.012586:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 9 pid: 6655 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.012600:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39216300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8426:1875727265899008:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833172.012671:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833172.021623:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39216300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8426:1875727265899008:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833172.021664:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.021687:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036000, rc 0) 00000100:00100000:0.0:1788833172.021750:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:11509:x1875727256466816:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 9310us (9495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833172.021759:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:0.0:1788833172.022958:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.023049:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256466944 00000100:00100000:2.0:1788833172.023057:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256466944 00010000:00010000:2.0:1788833172.023094:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 9 pid: 6655 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.023130:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:2.0:1788833172.023138:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256466944:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833172.023260:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833172.023285:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 9 pid: 6655 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.023300:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 9 pid: 6655 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.023321:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d966e6/0x8c08e876ed3ff5f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b11d expref: 9 pid: 6655 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.023355:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833172.023359:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833172.023367:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.023442:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.023480:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.023493:0:8413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39215c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8413:1875727265899136:192.168.206.55@tcp:105: 00000100:00100000:2.0:1788833172.023620:0:8413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833172.036052:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.040626:0:8413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39215c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8413:1875727265899136:192.168.206.55@tcp:105: 00010000:00010000:2.0:1788833172.040653:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833172.040712:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256466944:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 17574us (17759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833172.040724:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:1.0:1788833172.045280:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256467072 00000100:00100000:1.0:1788833172.045295:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256467072 00002000:00100000:1.0:1788833172.045355:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cea27225180 x1875727256467072/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:358/0 lens 504/0 e 0 to 0 dl 1788833183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788833172.045367:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea27225180 with x1875727256467072 ext(0->8) 00002000:00010000:1.0:1788833172.046023:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea27225180 00000100:00100000:1.0:1788833172.046121:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:1.0:1788833172.046134:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2358:x1875727256467072:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788833172.046619:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+10:2358:x1875727256467072:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 Request processed in 487us (10589us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788833172.046627:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00002000:00100000:1.0:1788833172.046636:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cea27225180 x1875727256467072/t4294967314(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:358/0 lens 504/448 e 0 to 0 dl 1788833183 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788833172.046645:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea27225180 with x1875727256467072 ext(0->8) 00002000:00010000:1.0:1788833172.046650:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea27225180 00000100:00100000:3.0:1788833172.056318:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833172.057986:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256467200 00000100:00100000:0.0:1788833172.058004:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256467200 00000100:00100000:0.0:1788833172.058090:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 183 00000100:00100000:0.0:1788833172.058101:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11509:x1875727256467200:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788833172.123416:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11509:x1875727256467200:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 Request processed in 65307us (67095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833172.123429:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 183 00000001:00080000:0.0:1788833172.123464:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:0.0:1788833172.123627:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788833172.123634:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1788833172.123682:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1788833172.123715:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788833172.123730:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce90207ecc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788833172.123734:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea05c29600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce90207e900 00000020:00080000:0.0:1788833172.123738:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea05c29200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea3f60dc00 00000100:00100000:0.0:1788833172.123968:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea27225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265899264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788833172.124016:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833172.124104:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265899264 00000100:00100000:0.0:1788833172.124110:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265899264 00000100:00100000:0.0:1788833172.124150:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788833172.124158:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265899264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788833172.124287:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788833172.124291:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788833171 00002000:00010000:0.0:1788833172.124294:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788833172.124295:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788833171 -> 1788833171 00002000:00010000:0.0:1788833172.124298:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788833172.124332:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875727265899264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (315us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788833172.124351:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788833172.124368:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788833172.124401:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea27225880/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788833172.124407:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea27225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265899264:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1788833172.125172:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788833172.125327:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788833172.125348:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833172.125360:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265899392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788833172.125800:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833172.125844:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265899392 00000100:00100000:2.0:1788833172.125860:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265899392 00000100:00100000:2.0:1788833172.125907:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788833172.125915:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1875727265899392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788833172.125935:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788833172.125964:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f6d91, atime: 0x6a9f6d91, ctime: 0x6a9f6d91, blocks: 0xb 00010000:00010000:2.0:1788833172.125972:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.125988:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1788833172.125993:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833172.126000:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.126017:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.126026:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.126070:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.126086:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788833172.129102:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833172.129863:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265899392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3943us (4057us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788833172.129876:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1788833172.129904:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833172.129919:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.129932:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833172.129937:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.129949:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.129969:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.129977:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ff604 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.129994:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833172.129995:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833172.129997:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833172.131827:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833172.131872:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256467328 00000100:00100000:1.0:1788833172.131882:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256467328 00000100:00100000:1.0:1788833172.131938:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:1.0:1788833172.131948:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+10:2357:x1875727256467328:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788833172.142119:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea39215c00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788833172.142133:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265899392:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788833172.185092:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788833172.185110:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788833172.191636:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1788833172.191775:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1788833172.191921:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256467328:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 Request processed in 59969us (60094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833172.191932:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:0.0:1788833172.198791:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.199210:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256467584 00000100:00100000:2.0:1788833172.199219:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256467584 00000100:00100000:2.0:1788833172.199285:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 184 00000100:00100000:2.0:1788833172.199296:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11509:x1875727256467584:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788833172.199346:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833172.199371:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff5ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b116 expref: 18 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.199420:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:2.0:1788833172.199425:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833172.199455:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.199467:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.199491:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833172.199757:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f852035 reply state 00000000b20f727d transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.199767:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833172.199866:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11509:x1875727256467584:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 570us (1082us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788833172.199874:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 184 00000100:00100000:3.0:1788833172.203103:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833172.203242:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256467712 00000100:00100000:1.0:1788833172.203252:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256467712 00000100:00100000:1.0:1788833172.203304:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 56 00000100:00100000:1.0:1788833172.203314:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256467712:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788833172.203545:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788833172.203549:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788833171 -> 1788833171 00002000:00010000:1.0:1788833172.203552:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788833169 00002000:00010000:1.0:1788833172.203554:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788833171 -> 1788833171 00002000:00010000:1.0:1788833172.203557:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788833172.203608:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2358:x1875727256467712:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 296us (514us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788833172.203616:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 56 00010000:00010000:0.0:1788833172.206059:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.206076:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.206084:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.206091:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833172.206095:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.206103:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.206118:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:0.0:1788833172.206122:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833172.206126:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.206149:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff60b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833172.209300:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.210350:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256467968 00000100:00100000:2.0:1788833172.210362:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256467968 00000100:00100000:2.0:1788833172.210439:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 185 00000100:00100000:2.0:1788833172.210448:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11509:x1875727256467968:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788833172.210524:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.210550:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.210576:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.210607:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.210619:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 18 pid: 5813 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.210633:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265899520:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833172.210739:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833172.212618:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265899520:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833172.212649:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833172.215012:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833172.215146:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256468096 00000100:00100000:0.0:1788833172.215156:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256468096 00010000:00010000:0.0:1788833172.215193:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 19 pid: 5813 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833172.215239:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:0.0:1788833172.215248:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:2357:x1875727256468096:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833172.215261:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833172.215268:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 19 pid: 5813 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.215282:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 19 pid: 5813 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.215303:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b108 expref: 19 pid: 5813 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.215319:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:0.0:1788833172.215324:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.215333:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.215340:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.215384:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833172.215434:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:2357:x1875727256468096:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 186us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833172.215441:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 70 00010000:00010000:1.0:1788833172.215655:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215664:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215692:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215708:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215714:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215721:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833172.215725:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215731:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215740:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:1.0:1788833172.215743:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788833172.215758:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833172.215765:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff612 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833172.215816:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+17:11509:x1875727256467968:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 Request processed in 5369us (6526us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788833172.215825:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 185 00000100:00100000:1.0:1788833172.218624:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.218928:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256468224 00000100:00100000:2.0:1788833172.218939:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256468224 00000100:00100000:2.0:1788833172.218999:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:2.0:1788833172.219010:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2358:x1875727256468224:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788833172.221324:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.221352:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.221360:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833172.221377:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833172.221382:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.221421:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.221438:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 8 pid: 8426 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.221454:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1875727265899648:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833172.221546:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833172.224882:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1875727265899648:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833172.224913:0:6654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833172.235980:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833172.239186:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256468352 00000100:00100000:3.0:1788833172.239201:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256468352 00010000:00010000:2.0:1788833172.239335:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 9 pid: 8426 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.239450:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 71 00000100:00100000:2.0:1788833172.239460:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256468352:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833172.239473:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833172.239494:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 9 pid: 8426 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.239524:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 9 pid: 8426 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.239554:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024fe0f0d/0x8c08e876ed3ff5fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b124 expref: 9 pid: 8426 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.239569:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833172.239573:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833172.239578:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.239587:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.241406:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833172.241483:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256468352:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 2021us (5507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833172.241494:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 71 00010000:00010000:0.0:1788833172.241984:0:6654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.241998:0:6654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.242492:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.242505:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.242512:0:6654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.242518:0:6654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036a00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833172.242522:0:6654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.242539:0:6654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.242576:0:6654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.242582:0:6654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff619 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833172.242708:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256468224:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 Request processed in 23696us (24089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833172.242718:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:0.0:1788833172.250518:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.250601:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256468608 00000100:00100000:2.0:1788833172.250610:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256468608 00000100:00100000:2.0:1788833172.250661:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 186 00000100:00100000:2.0:1788833172.250669:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+17:11509:x1875727256468608:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788833172.250746:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.250763:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.250780:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.250961:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.250972:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.250980:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.251009:0:8616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.251021:0:8616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 18 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.251078:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265899776:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833172.251144:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833172.257398:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833172.257454:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265899776:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833172.257483:0:8616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833172.257560:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256468736 00000100:00100000:3.0:1788833172.257566:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256468736 00010000:00010000:3.0:1788833172.257598:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 19 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833172.257636:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 72 00000100:00100000:3.0:1788833172.257645:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:2360:x1875727256468736:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833172.257658:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833172.257665:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 19 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.257690:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 19 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.257713:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff5e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b10f expref: 19 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.257727:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:3.0:1788833172.257733:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.257742:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.257749:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.257775:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833172.257832:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:2360:x1875727256468736:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 187us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833172.257839:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 72 00010000:00010000:0.0:1788833172.257901:0:8616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.257909:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833172.258153:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788833172.258553:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788833172.258599:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788833172.258669:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902910700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265899904:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788833172.258738:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833172.258773:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788833172.258905:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265899904 00000100:00100000:3.0:1788833172.258911:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265899904 00000100:00100000:3.0:1788833172.258952:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788833172.258961:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8616:x1875727265899904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788833172.259053:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8616:x1875727265899904:12345-0@lo:1000:mdt00_003.0 Request processed in 72us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833172.259061:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833172.259134:0:8616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788833172.259139:0:8616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea27225880, transno 4294967315 00000100:00100000:0.0:1788833172.259158:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902910700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265899904:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788833172.259758:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788833172.259821:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902910700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265900032:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788833172.259859:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833172.259893:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833172.260402:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265900032 00000100:00100000:3.0:1788833172.260409:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265900032 00000100:00100000:3.0:1788833172.260505:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788833172.260513:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8616:x1875727265900032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788833172.260706:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8616:x1875727265900032:12345-0@lo:1000:mdt00_003.0 Request processed in 193us (845us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788833172.260713:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788833172.260912:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902910700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265900032:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788833172.260944:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.260954:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.260962:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.260968:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833172.260972:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.260979:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.260993:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea1539c600) 00010000:00010000:0.0:1788833172.260996:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833172.261000:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261005:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff627 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261058:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261064:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261071:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261076:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dd200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833172.261078:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261084:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261092:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:0.0:1788833172.261094:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833172.261097:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261103:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff55c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261121:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261133:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261143:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261173:0:8616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.261187:0:8616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 21 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833172.261200:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902913480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265900160:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833172.261257:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833172.274330:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833172.274368:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256468864 00000100:00100000:0.0:1788833172.274382:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256468864 00010000:00010000:0.0:1788833172.274419:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 22 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833172.274455:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 73 00000100:00100000:0.0:1788833172.274466:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+22:2358:x1875727256468864:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833172.274481:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833172.274489:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 22 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.274501:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 22 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.274523:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:0.0:1788833172.274538:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.274560:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.274568:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.274587:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833172.274636:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+22:2358:x1875727256468864:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 173us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833172.274644:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 73 00010000:00010000:3.0:1788833172.275351:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b0f3 expref: 21 pid: 5811 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833172.275368:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902913480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265900160:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833172.275704:0:8616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275714:0:8616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275720:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275733:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275739:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275745:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275750:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925bc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833172.275763:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275770:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275781:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833172.275784:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833172.275787:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275794:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff62e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275804:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275809:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275814:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275819:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833172.275821:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275826:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275833:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833172.275835:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788833172.275844:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.275850:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff620 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833172.276141:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+20:11509:x1875727256468608:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 25471us (25630us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1788833172.276152:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 186 00000020:00080000:3.0:1788833172.276157:0:8616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788833172.279132:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833172.279488:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256469120 00000100:00100000:0.0:1788833172.279498:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256469120 00000100:00100000:0.0:1788833172.279601:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:0.0:1788833172.279612:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+20:11509:x1875727256469120:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788833172.281132:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788833172.281305:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1788833172.281441:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.281458:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.281469:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.281478:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.281485:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.281499:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.281527:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788833172.281632:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+22:11509:x1875727256469120:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 2019us (2504us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788833172.281642:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 50 00000020:00080000:0.0:1788833172.281648:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788833172.281736:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833172.281743:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.281751:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833172.281754:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.281771:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.281784:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cea08db1100) 00010000:00010000:2.0:1788833172.281787:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788833172.281792:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.281797:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.281812:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833172.281814:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833172.281815:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788833172.284907:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788833172.284916:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788833172.285458:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788833172.285468:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788833172.462167:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833172.753965:0:12478:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833172.754204:0:12478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833172.754249:0:12478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788833172.754257:0:12478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788833172.881842:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833172.881930:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256469376 00000100:00100000:3.0:1788833172.881939:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256469376 00000100:00100000:3.0:1788833172.882012:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 187 00000100:00100000:3.0:1788833172.882023:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+22:11528:x1875727256469376:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833172.882068:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833172.882105:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff63c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b12b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.882197:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff643 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.882211:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.882222:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833172.882234:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788833172.882358:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff63c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b12b expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.882394:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b12b expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.882403:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:3.0:1788833172.882406:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788833172.882409:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:3.0:1788833172.882462:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+24:11528:x1875727256469376:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 441us (629us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788833172.882469:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 187 00000100:00100000:1.0:1788833172.886740:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833172.886815:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256469504 00000100:00100000:2.0:1788833172.886824:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256469504 00000100:00100000:2.0:1788833172.886889:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 188 00000100:00100000:2.0:1788833172.886899:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+24:11528:x1875727256469504:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:2.0:1788833172.886970:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.886986:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.886997:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887111:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887131:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887144:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887362:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887372:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887379:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833172.887416:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887428:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887435:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887442:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887448:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833172.887452:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887460:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887479:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:2.0:1788833172.887482:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833172.887487:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887493:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887503:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887510:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887515:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887520:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833172.887523:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887538:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887546:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea1539c400) 00010000:00010000:2.0:1788833172.887548:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833172.887551:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887556:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887578:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887585:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887590:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887595:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833172.887598:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887603:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887610:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea1539c000) 00010000:00010000:2.0:1788833172.887612:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833172.887615:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833172.887619:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036c00/0x8c08e876ed3ff65f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833172.887689:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+24:11528:x1875727256469504:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 791us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833172.887698:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 188 00000100:00100000:2.0:1788833172.933900:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833172.934728:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256469760 00000100:00100000:3.0:1788833172.934740:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256469760 00000100:00100000:3.0:1788833172.934791:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 189 00000100:00100000:3.0:1788833172.934801:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+24:11531:x1875727256469760:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833172.934819:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833172.934838:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff666 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b132 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935284:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935298:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935307:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935321:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935335:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935342:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935657:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935665:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935672:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833172.935681:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788833172.935766:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935774:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935780:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935785:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833172.935790:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935797:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935818:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:3.0:1788833172.935821:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833172.935826:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.935832:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516c00/0x8c08e876ed3ff66d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.936737:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.936750:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.936758:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.936763:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833172.936766:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.936774:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.936785:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea32de4c00) 00010000:00010000:3.0:1788833172.936788:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833172.936791:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.936798:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ff674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.937104:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516000/0x8c08e876ed3ff666 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 27 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.937121:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 26 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.937129:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:3.0:1788833172.937132:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833172.937135:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd200, rc 0) 00000100:00100000:3.0:1788833172.937201:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11531:x1875727256469760:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 2400us (3309us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788833172.937209:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 189 00000100:00100000:1.0:1788833172.944199:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833172.944356:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256469888 00000100:00100000:3.0:1788833172.944367:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256469888 00000100:00100000:3.0:1788833172.944435:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 190 00000100:00100000:3.0:1788833172.944448:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11531:x1875727256469888:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:3.0:1788833172.944659:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944677:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944688:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944711:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944729:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944735:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944741:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dde00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833172.944746:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944754:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944768:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:3.0:1788833172.944772:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833172.944776:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833172.944782:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833172.945339:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11531:x1875727256469888:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 891us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833172.945350:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 190 00000100:00100000:0.0:1788833172.954925:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833172.954995:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256470144 00000100:00100000:3.0:1788833172.955005:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256470144 00000100:00100000:3.0:1788833172.955100:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:3.0:1788833172.955111:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11531:x1875727256470144:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833172.955624:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+27:11531:x1875727256470144:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 513us (706us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788833172.955643:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:3.0:1788833172.994839:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833172.995324:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256470400 00000100:00100000:0.0:1788833172.995335:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256470400 00000100:00100000:0.0:1788833172.995407:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 191 00000100:00100000:0.0:1788833172.995417:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+27:11066:x1875727256470400:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833172.995440:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833172.995461:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff690 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b139 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.995572:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.995587:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 28 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.995616:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.995654:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 28 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833172.995678:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 28 pid: 8616 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833172.995693:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265900288:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833172.995788:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788833173.007623:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.007969:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256470528 00000100:00100000:3.0:1788833173.007979:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256470528 00000100:00080000:1.0:1788833173.008058:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788833173.008061:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 29 pid: 8616 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.008167:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:3.0:1788833173.008180:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40ead180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+29:2358:x1875727256470528:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833173.008195:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833173.008202:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 29 pid: 8616 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.008215:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 29 pid: 8616 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.008237:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:3.0:1788833173.008242:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.008251:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.008269:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.008288:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833173.008453:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40ead180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+29:2358:x1875727256470528:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 274us (837us total) trans 0 rc 0/0 00010000:00010000:0.0:1788833173.008467:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff67b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b132 expref: 29 pid: 8616 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.008475:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:0.0:1788833173.008496:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265900288:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833173.008519:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.008540:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.008546:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833173.008564:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788833173.009892:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.009916:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.009925:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:1.0:1788833173.009928:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833173.009931:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ae00, rc 0) 00000100:00100000:1.0:1788833173.009987:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+28:11066:x1875727256470400:12345-192.168.206.55@tcp:101:bash.0 Request processed in 14572us (15158us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788833173.009995:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 191 00000100:00100000:1.0:1788833173.013784:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.013918:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256470784 00000100:00100000:3.0:1788833173.013928:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256470784 00000100:00100000:3.0:1788833173.013985:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 192 00000100:00100000:3.0:1788833173.013996:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+28:11066:x1875727256470784:12345-192.168.206.55@tcp:36:bash.0 00010000:00010000:3.0:1788833173.014303:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.014320:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.014331:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788833173.014382:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1788833173.014408:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a38f5b0 reply state 000000006589ca32 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.014418:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788833173.014464:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1788833173.014589:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11066:x1875727256470784:12345-192.168.206.55@tcp:36:bash.0 Request processed in 594us (813us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788833173.014597:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 192 00000020:00080000:3.0:1788833173.014602:0:8616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788833173.017224:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.017302:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256470912 00000100:00100000:2.0:1788833173.017311:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256470912 00000100:00100000:2.0:1788833173.017396:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 193 00010000:00010000:3.0:1788833173.017405:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.017407:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11066:x1875727256470912:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833173.017424:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.017436:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833173.017444:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.017451:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dde00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833173.017457:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.017457:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff6ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b140 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.017485:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.017501:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:3.0:1788833173.017505:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833173.017510:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.017517:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff6a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.017522:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff6ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b140 expref: 33 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.017549:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff6ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b140 expref: 32 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.017567:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:2.0:1788833173.017570:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833173.017573:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036000, rc 0) 00000100:00100000:2.0:1788833173.017627:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11066:x1875727256470912:12345-192.168.206.55@tcp:101:bash.0 Request processed in 222us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833173.017635:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 193 00000100:00100000:0.0:1788833173.023383:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.023538:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256471040 00000100:00100000:1.0:1788833173.023548:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256471040 00000100:00100000:1.0:1788833173.023673:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00100000:1.0:1788833173.023685:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:11066:x1875727256471040:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1788833173.023701:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833173.023720:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b147 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833173.025289:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f6d93, atime: 0x6a9f6d91, ctime: 0x6a9f6d93, blocks: 0xb 00010000:00010000:1.0:1788833173.025327:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1788833173.025333:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833173.025356:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.025386:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.025399:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02facc00, rc 0) 00000100:00100000:1.0:1788833173.025464:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+8:11066:x1875727256471040:12345-192.168.206.55@tcp:101:bash.0 Request processed in 1781us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833173.025472:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00080000:0.0:1788833173.025640:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833173.031692:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.031788:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256471168 00000100:00100000:2.0:1788833173.031798:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256471168 00002000:00010000:2.0:1788833173.031839:0:6661:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788833173.031844:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea40ead880 with x1875727256471168 ext(0->18446744073709551615) 00002000:00010000:2.0:1788833173.031855:0:6661:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea40ead880. 00000100:00100000:2.0:1788833173.031890:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:2.0:1788833173.031900:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256471168:12345-192.168.206.55@tcp:10:bash.0 00002000:00010000:2.0:1788833173.032215:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788833173.032219:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788833171 -> 1788833172 00002000:00010000:2.0:1788833173.032234:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788833169 -> 1788833169 00002000:00010000:2.0:1788833173.032237:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788833171 -> 1788833172 00002000:00010000:2.0:1788833173.032240:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788833173.032290:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256471168:12345-192.168.206.55@tcp:10:bash.0 Request processed in 392us (608us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788833173.032297:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00002000:00010000:2.0:1788833173.032301:0:6661:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788833173.032304:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea40ead880 with x1875727256471168 ext(0->18446744073709551615) 00002000:00010000:2.0:1788833173.032308:0:6661:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea40ead880. 00000100:00100000:2.0:1788833173.117088:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.117253:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256471296 00000100:00100000:1.0:1788833173.117263:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256471296 00000100:00100000:1.0:1788833173.117321:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 194 00000100:00100000:1.0:1788833173.117331:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11545:x1875727256471296:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:1.0:1788833173.117412:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117433:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117455:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117471:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117478:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117502:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117721:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117730:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117736:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788833173.117772:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117783:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117789:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117794:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117800:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.117804:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117811:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117823:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833173.117832:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.117837:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117843:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117856:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117862:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117867:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117872:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.117875:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117881:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117888:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea0884e800) 00010000:00010000:1.0:1788833173.117891:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.117893:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117897:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117910:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117920:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117925:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117930:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02face00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.117933:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117938:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117945:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:1.0:1788833173.117947:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.117950:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.117954:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.118089:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11545:x1875727256471296:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 757us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833173.118097:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 194 00000100:00100000:0.0:1788833173.158634:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.160249:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256471552 00000100:00100000:1.0:1788833173.160262:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256471552 00000100:00100000:1.0:1788833173.160347:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 195 00000100:00100000:1.0:1788833173.160357:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+32:11548:x1875727256471552:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833173.160386:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833173.160419:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b14e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160491:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160504:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160516:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160540:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160548:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160554:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160807:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160817:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160824:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833173.160833:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788833173.160923:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160940:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160946:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160952:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.160956:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160962:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.160987:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833173.160990:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.160994:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161502:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161516:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161522:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161539:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161544:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.161555:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161562:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161571:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea0884e800) 00010000:00010000:1.0:1788833173.161574:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.161577:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161584:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff6dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161627:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02face00/0x8c08e876ed3ff6cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b14e expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161642:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b14e expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.161650:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:1.0:1788833173.161652:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788833173.161655:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02faca00, rc 0) 00000100:00100000:1.0:1788833173.161728:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+34:11548:x1875727256471552:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 1372us (3102us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788833173.161737:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 195 00000100:00100000:2.0:1788833173.168644:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833173.168743:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256471680 00000100:00100000:0.0:1788833173.168753:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256471680 00000100:00100000:0.0:1788833173.168822:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 196 00000100:00100000:0.0:1788833173.168832:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+34:11548:x1875727256471680:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:0.0:1788833173.168893:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.168910:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.168920:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.168952:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.168965:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 34 pid: 5811 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833173.168991:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902910a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265900416:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833173.169101:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788833173.171807:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.172071:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256471936 00000100:00100000:1.0:1788833173.172081:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256471936 00000100:00100000:1.0:1788833173.172141:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:1.0:1788833173.172151:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:6056:x1875727256471936:12345-192.168.206.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788833173.172470:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+36:6056:x1875727256471936:12345-192.168.206.55@tcp:35:ldlm_bl.0 Request processed in 319us (669us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788833173.172477:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:2.0:1788833173.174501:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.174722:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256472064 00000100:00100000:3.0:1788833173.174732:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256472064 00010000:00010000:3.0:1788833173.174771:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 36 pid: 5811 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.174807:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:3.0:1788833173.174817:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+36:2358:x1875727256472064:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833173.174831:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833173.174837:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 36 pid: 5811 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.174865:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 36 pid: 5811 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.174886:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:3.0:1788833173.174891:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.174901:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.174908:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.174927:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833173.174984:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+36:2358:x1875727256472064:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 169us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.174991:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 75 00010000:00010000:0.0:1788833173.175213:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff697 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b139 expref: 35 pid: 5811 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833173.175232:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902910a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1875727265900416:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833173.175251:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175269:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175275:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175301:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175309:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175317:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175324:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833173.175329:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175336:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175347:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:0.0:1788833173.175350:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833173.175354:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.175360:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff6f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833173.175399:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+34:11548:x1875727256471680:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 6568us (6764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833173.175413:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 196 00000100:00100000:2.0:1788833173.179142:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.179270:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256472320 00000100:00100000:1.0:1788833173.179279:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256472320 00000100:00100000:1.0:1788833173.179379:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:1.0:1788833173.179389:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+34:11548:x1875727256472320:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:1.0:1788833173.180236:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:11548:x1875727256472320:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 845us (1098us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788833173.180245:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:1.0:1788833173.208891:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.208942:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.208977:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.209128:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256472448 00000100:00100000:2.0:1788833173.209139:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256472448 00000100:00100000:0.0:1788833173.209158:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256472576 00000100:00100000:0.0:1788833173.209164:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256472576 00000100:00100000:2.0:1788833173.209194:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 292 00000100:00100000:2.0:1788833173.209205:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256472448:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833173.209213:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 87 00000100:00100000:0.0:1788833173.209224:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256472576:12345-192.168.206.55@tcp:400:kworker.0 00000100:00080000:1.0:1788833173.209307:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833173.209410:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2359:x1875727256472576:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 187us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833173.209422:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2359:x1875727256472448:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 217us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833173.209422:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 87 00000100:00100000:2.0:1788833173.209434:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 292 00000100:00100000:3.0:1788833173.209744:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256472704 00000100:00100000:3.0:1788833173.209749:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256472704 00000100:00100000:3.0:1788833173.209802:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 145 00000100:00100000:3.0:1788833173.209811:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256472704:12345-192.168.206.55@tcp:400:kworker.0 00000100:00080000:0.0:1788833173.209811:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833173.209848:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2359:x1875727256472704:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 40us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.209855:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 145 00000100:00100000:2.0:1788833173.268971:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.269071:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256472960 00000100:00100000:1.0:1788833173.269081:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256472960 00000100:00100000:1.0:1788833173.269137:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 197 00000100:00100000:1.0:1788833173.269147:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+35:11559:x1875727256472960:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:1.0:1788833173.269167:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833173.269186:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b155 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269275:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269290:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269317:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269332:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269339:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269345:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269606:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff70e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269616:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff70e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269624:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff70e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833173.269638:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788833173.269729:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269736:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269742:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269749:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.269759:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269767:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269779:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833173.269783:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.269787:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269793:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269806:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269812:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269817:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269823:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.269830:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269837:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269843:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea0884e800) 00010000:00010000:1.0:1788833173.269846:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.269854:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269860:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad800/0x8c08e876ed3ff707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269902:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff6f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b155 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269916:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff70e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b155 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.269922:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:1.0:1788833173.269924:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833173.269927:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fade00, rc 0) 00000100:00100000:1.0:1788833173.269981:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+37:11559:x1875727256472960:12345-192.168.206.55@tcp:101:cat.0 Request processed in 835us (1019us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788833173.269989:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 197 00000100:00100000:1.0:1788833173.276194:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.276607:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256473216 00000100:00100000:3.0:1788833173.276617:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256473216 00000100:00100000:3.0:1788833173.277368:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:3.0:1788833173.277396:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+37:11559:x1875727256473216:12345-192.168.206.55@tcp:35:cat.0 00000100:00100000:3.0:1788833173.277678:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+38:11559:x1875727256473216:12345-192.168.206.55@tcp:35:cat.0 Request processed in 284us (1495us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788833173.277685:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:2.0:1788833173.303929:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833173.304095:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256473472 00000100:00100000:0.0:1788833173.304106:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256473472 00000100:00100000:0.0:1788833173.304222:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 198 00000100:00100000:0.0:1788833173.304234:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+38:11560:x1875727256473472:12345-192.168.206.55@tcp:36:rm.0 00010000:00010000:0.0:1788833173.304292:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788833173.304339:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff70e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b155 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304361:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02faca00/0x8c08e876ed3ff6e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b14e expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304373:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff6ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b140 expref: 36 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304383:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea32de4b00) 00010000:00010000:0.0:1788833173.304392:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833173.304425:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304584:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304595:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304610:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304617:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304624:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304851:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304861:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.304868:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833173.305717:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788833173.305729:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307371697037ns, next at 308371694342ns, rc = 0 00010000:00010000:0.0:1788833173.305792:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.305803:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.305822:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.305829:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.305835:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.305840:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306186:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833173.306208:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306216:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306222:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306228:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833173.306232:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306238:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306250:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:0.0:1788833173.306253:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788833173.306265:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306270:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff72a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306288:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306294:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306300:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306304:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833173.306306:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306312:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306318:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833173.306321:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833173.306324:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.306329:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a400/0x8c08e876ed3ff71c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788833173.306338:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007300fe72 reply state 000000004747e996 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833173.306357:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833173.306565:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+37:11560:x1875727256473472:12345-192.168.206.55@tcp:36:rm.0 Request processed in 2329us (2640us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788833173.306573:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 198 00010000:00010000:2.0:1788833173.307621:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833173.307633:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.307658:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925aa00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833173.307662:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.307670:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.307684:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:2.0:1788833173.307686:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788833173.307690:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.307696:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff731 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.307713:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833173.307715:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833173.307716:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833173.308388:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.308398:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.308404:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.308409:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ae00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833173.308413:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.308419:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.308431:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea08db1c00) 00010000:00010000:0.0:1788833173.308433:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833173.308436:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.309021:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ff723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.358767:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.361091:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256473728 00000100:00100000:3.0:1788833173.361104:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256473728 00000100:00100000:2.0:1788833173.361418:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 199 00000100:00100000:2.0:1788833173.361431:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+36:11566:x1875727256473728:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1788833173.361464:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833173.361493:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b15c expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.361616:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.361631:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.361656:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.361672:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.361680:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.361686:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788833173.362359:0:11926:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788833173.362688:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362700:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362709:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362741:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362748:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362754:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362760:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833173.362771:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362779:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362792:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:2.0:1788833173.362795:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833173.362800:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362806:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff73f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833173.362820:0:11926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d10867a9 reply state 000000009fa45ebb transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.362830:0:11926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788833173.362860:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 39 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362874:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 38 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.362881:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea1539c400) 00010000:00010000:2.0:1788833173.362883:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833173.362886:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036600, rc 0) 00000100:00100000:2.0:1788833173.364933:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11566:x1875727256473728:12345-192.168.206.55@tcp:101:bash.0 Request processed in 3496us (6168us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788833173.364954:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 199 00010000:00010000:3.0:1788833173.367682:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.367698:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.367705:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.367711:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833173.367715:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.367722:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.367738:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea1539c000) 00010000:00010000:3.0:1788833173.367741:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833173.367745:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.367750:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff746 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.367882:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.368238:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256473856 00000100:00100000:3.0:1788833173.368263:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256473856 00000100:00100000:3.0:1788833173.368330:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:3.0:1788833173.368340:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256473856:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833173.368357:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833173.368387:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b163 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833173.368411:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788833173.368429:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1788833173.368433:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833173.368694:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.368715:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.368728:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833173.368790:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2358:x1875727256473856:12345-192.168.206.55@tcp:101:bash.0 Request processed in 451us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.368797:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:2.0:1788833173.375994:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.376265:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256473984 00000100:00100000:1.0:1788833173.376276:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256473984 00000100:00100000:1.0:1788833173.376333:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:1.0:1788833173.376345:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+6:11566:x1875727256473984:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1788833173.376360:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833173.376389:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b16a expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.376422:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.376447:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833173.376451:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833173.376457:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 7 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.376503:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.376517:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 7 pid: 6656 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.376543:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1875727265900544:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833173.376629:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea397df300 going to sleep for 11 seconds 00000100:00100000:1.0:1788833173.379881:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6654:1875727265900544:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833173.379919:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 7 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.379940:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fad800, rc 0) 00000100:00100000:1.0:1788833173.380289:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:11566:x1875727256473984:12345-192.168.206.55@tcp:101:bash.0 Request processed in 3945us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833173.380297:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:2.0:1788833173.381910:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.382061:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256474112 00000100:00100000:3.0:1788833173.382071:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256474112 00010000:00010000:3.0:1788833173.382112:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 7 pid: 6656 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.382152:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 76 00000100:00100000:3.0:1788833173.382161:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256474112:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833173.382190:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833173.382211:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 7 pid: 6656 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.382224:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 7 pid: 6656 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.382246:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dbb9118/0x8c08e876ed3ff75b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b163 expref: 7 pid: 6656 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.382264:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833173.382268:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833173.382276:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.382286:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.382321:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.382335:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265900672:192.168.206.55@tcp:105: 00000100:00100000:3.0:1788833173.382425:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce90207ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833173.388441:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833173.388535:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256474368 00000100:00100000:0.0:1788833173.388544:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256474368 00000100:00100000:0.0:1788833173.388613:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:0.0:1788833173.388623:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+38:11566:x1875727256474368:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:0.0:1788833173.388974:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11566:x1875727256474368:12345-192.168.206.55@tcp:35:bash.0 Request processed in 350us (540us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788833173.388982:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:3.0:1788833173.390461:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1875727265900672:192.168.206.55@tcp:105: 00010000:00010000:3.0:1788833173.390486:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833173.390561:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256474112:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 8400us (8659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.390570:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 76 00010000:00010000:2.0:1788833173.485878:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833173.553684:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.553849:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256474496 00000100:00100000:3.0:1788833173.553859:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256474496 00000100:00100000:3.0:1788833173.553920:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 200 00000100:00100000:3.0:1788833173.553930:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+39:11582:x1875727256474496:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833173.553961:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833173.555748:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b171 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.555832:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.555847:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.555859:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833173.555892:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788833173.555896:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833173.555912:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.555941:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b171 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.555964:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b171 expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.555992:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:3.0:1788833173.555995:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833173.555999:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dca00, rc 0) 00000100:00100000:3.0:1788833173.556117:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+40:11582:x1875727256474496:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 2187us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.556125:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 200 00000100:00100000:0.0:1788833173.559655:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.559739:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256474752 00000100:00100000:2.0:1788833173.559749:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256474752 00000100:00100000:2.0:1788833173.559804:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 201 00000100:00100000:2.0:1788833173.559814:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+40:11582:x1875727256474752:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833173.559833:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833173.559850:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b178 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.559945:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff77e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.559960:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff77e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.559970:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff77e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833173.559981:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788833173.560136:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b178 expref: 43 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.560155:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff77e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b178 expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.560183:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea1539c400) 00010000:00010000:2.0:1788833173.560186:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833173.560189:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037000, rc 0) 00000100:00100000:2.0:1788833173.560248:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+42:11582:x1875727256474752:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 435us (602us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788833173.560255:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 201 00000100:00100000:1.0:1788833173.564700:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.564752:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.564831:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256475008 00000100:00100000:2.0:1788833173.564840:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256475008 00000100:00100000:2.0:1788833173.564898:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 202 00000100:00100000:2.0:1788833173.564908:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+42:11582:x1875727256475008:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833173.564929:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833173.564947:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff78c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b17f expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.565096:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff793 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.565109:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.565120:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833173.565132:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788833173.565249:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff78c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b17f expref: 45 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.565281:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b17f expref: 44 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.565289:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea1539c400) 00010000:00010000:2.0:1788833173.565292:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788833173.565295:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036a00, rc 0) 00000100:00100000:2.0:1788833173.565353:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+44:11582:x1875727256475008:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 446us (664us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788833173.565360:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 202 00000100:00100000:3.0:1788833173.565561:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256475136 00000100:00100000:3.0:1788833173.565566:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256475136 00000100:00100000:3.0:1788833173.565609:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:3.0:1788833173.565617:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+44:2360:x1875727256475136:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833173.565627:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833173.565642:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037000/0x8c08e876ed3ff77e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b178 expref: 44 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.565653:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea1539c400) 00010000:00010000:3.0:1788833173.565656:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833173.565676:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+43:2360:x1875727256475136:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 61us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.565684:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:0.0:1788833173.576885:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.581845:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256475264 00000100:00100000:1.0:1788833173.581874:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256475264 00000100:00100000:1.0:1788833173.581933:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:1.0:1788833173.581943:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+6:2357:x1875727256475264:12345-192.168.206.55@tcp:1:lfs.0 00010000:00010000:1.0:1788833173.581983:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.582004:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.582013:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833173.582017:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833173.582021:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.582124:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 6 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.582138:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 6 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.582152:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875727265900800:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833173.582278:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea397df300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833173.589343:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.589981:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256475392 00000100:00100000:3.0:1788833173.589992:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256475392 00002000:00100000:3.0:1788833173.590076:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ce902911180 x1875727256475392/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:359/0 lens 504/0 e 0 to 0 dl 1788833184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833173.590087:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce902911180 with x1875727256475392 ext(0->8) 00010000:00010000:3.0:1788833173.590097:0:6659:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 7 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.590127:0:6659:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 7 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833173.590137:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ce902911180 00000100:00100000:3.0:1788833173.590170:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:3.0:1788833173.590180:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256475392:12345-192.168.206.55@tcp:4:lfs.0 00000100:00100000:3.0:1788833173.590923:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2358:x1875727256475392:12345-192.168.206.55@tcp:4:lfs.0 Request processed in 738us (1585us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788833173.590932:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00002000:00100000:3.0:1788833173.590940:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ce902911180 x1875727256475392/t4294967308(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:359/0 lens 504/448 e 0 to 0 dl 1788833184 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833173.590950:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ce902911180 with x1875727256475392 ext(0->8) 00010000:00010000:3.0:1788833173.590957:0:6659:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 9 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.590973:0:6659:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 9 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833173.590980:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ce902911180 00000100:00100000:1.0:1788833173.591087:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875727265900800:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833173.591110:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.595445:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.595637:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256475520 00000100:00100000:3.0:1788833173.595647:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256475520 00010000:00010000:3.0:1788833173.595684:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 9 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.595751:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 77 00000100:00100000:3.0:1788833173.595760:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256475520:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833173.595773:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788833173.595790:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788833173.595792:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788833173 00002000:00010000:3.0:1788833173.595795:0:5797:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788833173 00002000:00010000:3.0:1788833173.595797:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788833173 00010000:00010000:3.0:1788833173.595802:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 9 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.595814:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 9 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.595836:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63ea151/0x8c08e876ed3ff762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b16a expref: 9 pid: 6654 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.595851:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833173.595855:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833173.595861:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.595871:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.595903:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833173.595961:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256475520:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 202us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.595968:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 77 00010000:00010000:1.0:1788833173.596718:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596732:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596758:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596767:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596775:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596782:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833173.596786:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596795:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596809:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.596832:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f423d9b/0x8c08e876ed3ff7a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.596905:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256475264:12345-192.168.206.55@tcp:1:lfs.0 Request processed in 14961us (20029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833173.596914:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:2.0:1788833173.601937:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833173.602014:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256475776 00000100:00100000:0.0:1788833173.602023:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256475776 00000100:00100000:0.0:1788833173.602104:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 56 00000100:00100000:0.0:1788833173.602114:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+43:11582:x1875727256475776:12345-192.168.206.55@tcp:35:lfs.0 00000004:00010000:0.0:1788833173.602169:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b17f expref: 43 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833173.602407:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788833173.602454:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788833173.602988:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1788833173.603067:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.603082:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 47 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.603091:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.603125:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 47 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.603154:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 47 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833173.603168:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902912a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265900928:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833173.603342:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833173.607440:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.608064:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256475904 00000100:00100000:3.0:1788833173.608073:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256475904 00010000:00010000:3.0:1788833173.608111:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 48 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.608154:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 78 00000100:00100000:3.0:1788833173.608164:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902911880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+48:2358:x1875727256475904:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833173.608181:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833173.608187:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 48 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.608199:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 48 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.608220:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea1539c400) 00010000:00010000:3.0:1788833173.608225:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.608233:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.608240:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.608257:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833173.608312:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902911880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+48:2358:x1875727256475904:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 150us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.608332:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 78 00010000:00010000:1.0:1788833173.609674:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff74d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b15c expref: 47 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.609695:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902912a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1875727265900928:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833173.609849:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.609942:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.609950:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833173.610192:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1788833173.610459:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788833173.610672:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902912d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265901056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788833173.610900:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833173.610992:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833173.611179:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265901056 00000100:00100000:3.0:1788833173.611186:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265901056 00000100:00100000:3.0:1788833173.611266:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788833173.611276:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1875727265901056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788833173.611412:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1875727265901056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 137us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.611419:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788833173.611628:0:5815:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788833173.611634:0:5815:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788833173.611657:0:5815:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9cea39215c00 x1875727265899392/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788833188 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833173.611669:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902912d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265901056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788833173.612250:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788833173.612318:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265901184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788833173.612357:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833173.612488:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea397df180 going to sleep for 11 seconds 00000100:00100000:3.0:1788833173.612616:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265901184 00000100:00100000:3.0:1788833173.612623:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265901184 00000100:00100000:3.0:1788833173.612655:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788833173.612663:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1875727265901184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788833173.612822:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5815:x1875727265901184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 158us (463us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788833173.612829:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788833173.612906:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1875727265901184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788833173.612958:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788833173.613006:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.613016:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.613023:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.613059:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.613064:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.613072:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.613087:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea1539c400) 00010000:00010000:1.0:1788833173.613090:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788833173.613094:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.613100:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ff7a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788833173.613266:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788833173.613445:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788833173.613460:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307679427949ns, next at 308679425174ns, rc = 0 00000001:00080000:1.0:1788833173.613545:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788833173.613585:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea1539c400) 00010000:00010000:1.0:1788833173.613589:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788833173.613596:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff793 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b17f expref: 51 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.613707:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+50:11582:x1875727256475776:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 11593us (11778us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788833173.613716:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 56 00000020:00080000:1.0:1788833173.613720:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788833173.616698:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.616787:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256476032 00000100:00100000:3.0:1788833173.616796:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256476032 00000100:00100000:3.0:1788833173.616891:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 203 00000100:00100000:3.0:1788833173.616900:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+50:11582:x1875727256476032:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833173.616922:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833173.616945:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff7af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b186 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.617000:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b186 expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.617063:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b186 expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.617087:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:3.0:1788833173.617090:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788833173.617094:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dde00, rc 0) 00000100:00100000:3.0:1788833173.617150:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+51:11582:x1875727256476032:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 250us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.617157:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 203 00000100:00100000:2.0:1788833173.623851:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.623985:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256476288 00000100:00100000:3.0:1788833173.623995:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256476288 00000100:00100000:3.0:1788833173.624160:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:3.0:1788833173.624173:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+51:11582:x1875727256476288:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833173.624499:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+52:11582:x1875727256476288:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 328us (658us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788833173.624507:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:0.0:1788833173.716216:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.716393:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256476416 00000100:00100000:1.0:1788833173.716403:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256476416 00000100:00100000:1.0:1788833173.716463:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 204 00000100:00100000:1.0:1788833173.716483:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+52:11592:x1875727256476416:12345-192.168.206.55@tcp:34:lfs.0 00010000:00010000:1.0:1788833173.716567:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.716586:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.716600:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.716616:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.716622:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.716629:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717095:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717124:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717132:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788833173.717172:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717185:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717191:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717197:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717204:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.717208:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717215:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717227:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833173.717230:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.717234:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717241:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff7b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717262:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717268:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717273:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717277:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.717280:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717286:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717293:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea0884e800) 00010000:00010000:1.0:1788833173.717296:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.717299:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717305:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717318:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717324:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717330:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717342:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833173.717345:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717351:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717359:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833173.717362:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833173.717378:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.717383:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.717581:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+52:11592:x1875727256476416:12345-192.168.206.55@tcp:34:lfs.0 Request processed in 1097us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833173.717591:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 204 00000100:00100000:2.0:1788833173.766530:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833173.767123:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256476672 00000100:00100000:0.0:1788833173.767134:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256476672 00000100:00100000:0.0:1788833173.767240:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 205 00000100:00100000:0.0:1788833173.767252:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+52:11595:x1875727256476672:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833173.767271:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833173.767292:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff7cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b18d expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767457:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767479:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767491:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767505:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767511:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767517:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767645:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767654:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767661:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833173.767671:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788833173.767782:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767800:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767808:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767814:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833173.767818:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767825:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767837:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833173.767840:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833173.767845:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767851:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff7d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767864:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767870:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767877:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767882:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833173.767891:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767899:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767907:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea08db1c00) 00010000:00010000:0.0:1788833173.767910:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833173.767913:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.767919:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a800/0x8c08e876ed3ff7d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.768193:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff7cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 55 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.768209:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 54 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.768217:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:0.0:1788833173.768220:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833173.768222:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925be00, rc 0) 00000100:00100000:0.0:1788833173.768302:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11595:x1875727256476672:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 1053us (1794us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788833173.768310:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 205 00000100:00100000:3.0:1788833173.772593:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.773345:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256476800 00000100:00100000:2.0:1788833173.773355:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256476800 00000100:00100000:2.0:1788833173.773431:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 206 00000100:00100000:2.0:1788833173.773441:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11595:x1875727256476800:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:2.0:1788833173.773669:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773687:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773698:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773723:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773743:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773749:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773755:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833173.773760:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773767:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773780:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833173.773783:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833173.773787:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.773793:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff7ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.773869:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11595:x1875727256476800:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 428us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833173.773877:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 206 00000100:00100000:2.0:1788833173.776477:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.777343:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256477056 00000100:00100000:3.0:1788833173.777353:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256477056 00000100:00100000:3.0:1788833173.777403:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00100000:3.0:1788833173.777412:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+54:11595:x1875727256477056:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833173.777684:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11595:x1875727256477056:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 272us (1222us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788833173.777692:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00100000:3.0:1788833173.874770:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833173.874869:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256477312 00000100:00100000:1.0:1788833173.874877:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256477312 00000100:00100000:1.0:1788833173.874937:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 207 00000100:00100000:1.0:1788833173.874957:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11605:x1875727256477312:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1788833173.874981:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833173.874984:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788833173.875009:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b171 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.875074:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833173.875092:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833173.875107:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b194 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.875215:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.875228:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 55 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.875235:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.875265:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 55 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.875278:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 55 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833173.875290:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265901312:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833173.875386:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea397df600 going to sleep for 11 seconds 00000100:00100000:1.0:1788833173.879693:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1875727265901312:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833173.879743:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.882280:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.882379:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256477440 00000100:00100000:2.0:1788833173.882389:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256477440 00010000:00010000:2.0:1788833173.882427:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 56 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.882485:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:2.0:1788833173.882496:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+56:2357:x1875727256477440:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833173.882511:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833173.882518:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 56 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.882541:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 56 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.882565:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925be00/0x8c08e876ed3ff7e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b18d expref: 56 pid: 11926 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.882582:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833173.882587:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.882598:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.882605:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833173.882831:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833173.882888:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+55:2357:x1875727256477440:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 393us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833173.882896:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 79 00010000:00010000:1.0:1788833173.884247:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.884262:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833173.884295:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788833173.884448:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff7f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.884476:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833173.884485:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833173.884488:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833173.884491:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fad200, rc 0) 00000100:00100000:1.0:1788833173.884595:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11605:x1875727256477312:12345-192.168.206.55@tcp:101:bash.0 Request processed in 9648us (9832us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788833173.884603:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 207 00000100:00100000:2.0:1788833173.889938:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833173.890184:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256477696 00000100:00100000:0.0:1788833173.890194:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256477696 00000100:00100000:0.0:1788833173.890289:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 208 00000100:00100000:0.0:1788833173.890299:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+55:11605:x1875727256477696:12345-192.168.206.55@tcp:36:bash.0 00010000:00010000:0.0:1788833173.890574:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.890592:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.890602:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833173.890651:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1788833173.890676:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f343e53d reply state 0000000087ffe9f8 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833173.890685:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833173.890784:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11605:x1875727256477696:12345-192.168.206.55@tcp:36:bash.0 Request processed in 485us (853us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788833173.890791:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 208 00000020:00080000:0.0:1788833173.890796:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788833173.892492:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.892508:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.892516:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.892531:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925aa00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833173.892536:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.892545:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.892559:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:3.0:1788833173.892562:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833173.892566:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.892573:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925aa00/0x8c08e876ed3ff80a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.897507:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.897628:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256477824 00000100:00100000:3.0:1788833173.897638:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256477824 00000100:00100000:3.0:1788833173.897697:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 209 00000100:00100000:3.0:1788833173.897707:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11605:x1875727256477824:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833173.897727:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833173.897759:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff811 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b19b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.897851:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.897865:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.897873:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.897905:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.897918:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 58 pid: 5812 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.897931:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265901440:192.168.206.55@tcp:104: 00000100:00100000:3.0:1788833173.898075:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce90207ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833173.900115:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265901440:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833173.900141:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833173.902189:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833173.902689:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256477952 00000100:00100000:3.0:1788833173.902699:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256477952 00010000:00010000:3.0:1788833173.902735:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 59 pid: 5812 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833173.902778:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:3.0:1788833173.902787:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+59:2358:x1875727256477952:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833173.902800:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833173.902806:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 59 pid: 5812 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.902830:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 59 pid: 5812 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.902851:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff7fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b194 expref: 59 pid: 5812 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.902866:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:3.0:1788833173.902870:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.902878:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.902886:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833173.902911:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833173.902973:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+58:2358:x1875727256477952:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 186us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833173.902981:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 80 00010000:00010000:0.0:1788833173.903355:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.903375:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833173.903415:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788833173.903419:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833173.903437:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.903478:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff811 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.903509:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833173.903517:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:0.0:1788833173.903531:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833173.903534:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dca00, rc 0) 00000100:00100000:0.0:1788833173.903565:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11605:x1875727256477824:12345-192.168.206.55@tcp:101:bash.0 Request processed in 5860us (6066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833173.903572:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 209 00000100:00100000:3.0:1788833173.907773:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833173.907900:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256478208 00000100:00100000:2.0:1788833173.907909:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256478208 00000100:00100000:2.0:1788833173.907962:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:2.0:1788833173.907971:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+57:11605:x1875727256478208:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:2.0:1788833173.908233:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11605:x1875727256478208:12345-192.168.206.55@tcp:35:bash.0 Request processed in 262us (469us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788833173.908241:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:1.0:1788833174.022699:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.023079:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256478336 00000100:00100000:2.0:1788833174.023090:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256478336 00000100:00100000:2.0:1788833174.023156:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 210 00000100:00100000:2.0:1788833174.023166:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+58:11611:x1875727256478336:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833174.023188:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833174.023209:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff81f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1a2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.023271:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.023285:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.023305:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833174.023349:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788833174.023353:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833174.023369:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.023392:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036a00/0x8c08e876ed3ff81f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1a2 expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.023410:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1a2 expref: 59 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.023418:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:2.0:1788833174.023421:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833174.023425:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036600, rc 0) 00000100:00100000:2.0:1788833174.023487:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+59:11611:x1875727256478336:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 322us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.023495:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 210 00000100:00100000:0.0:1788833174.027015:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.027155:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256478464 00000100:00100000:2.0:1788833174.027166:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256478464 00000100:00100000:2.0:1788833174.027214:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 211 00000100:00100000:2.0:1788833174.027225:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+59:11611:x1875727256478464:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833174.027242:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833174.027264:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff82d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1a9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027341:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027374:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027386:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027403:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027410:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027416:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027500:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027508:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027516:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833174.027559:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788833174.027563:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833174.027582:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027594:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027616:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027622:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027629:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027635:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833174.027640:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027648:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027661:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:2.0:1788833174.027664:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833174.027669:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027675:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027688:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027695:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027701:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027712:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036e00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833174.027716:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027722:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027730:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea1539cf00) 00010000:00010000:2.0:1788833174.027733:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833174.027736:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027742:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036e00/0x8c08e876ed3ff83b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027774:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036400/0x8c08e876ed3ff82d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1a9 expref: 61 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027788:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1a9 expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.027796:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833174.027798:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833174.027801:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037800, rc 0) 00000100:00100000:2.0:1788833174.027882:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11611:x1875727256478464:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 658us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.027889:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 211 00000100:00100000:3.0:1788833174.038461:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833174.038534:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.038639:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256478848 00000100:00100000:1.0:1788833174.038649:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256478848 00000100:00100000:0.0:1788833174.038684:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256478720 00000100:00100000:0.0:1788833174.038688:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256478720 00000100:00100000:0.0:1788833174.038728:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 212 00000100:00100000:0.0:1788833174.038737:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11611:x1875727256478720:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833174.038756:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833174.038776:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833174.038845:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:2.0:1788833174.038863:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+62:2357:x1875727256478848:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833174.038872:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833174.038888:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.038892:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037800/0x8c08e876ed3ff842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1a9 expref: 62 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.038901:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.038908:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.042083:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833174.042099:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.042111:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.042118:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833174.042212:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+61:2357:x1875727256478848:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 3346us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.042223:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00010000:00010000:0.0:1788833174.042717:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.042737:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 60 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.042753:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902912a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265901568:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833174.042827:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788833174.047829:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.047899:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902912a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1875727265901568:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833174.047931:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833174.048283:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256478976 00000100:00100000:3.0:1788833174.048292:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256478976 00010000:00010000:3.0:1788833174.048329:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 61 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833174.048395:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 81 00000100:00100000:3.0:1788833174.048405:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+61:2357:x1875727256478976:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833174.048421:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833174.048427:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 61 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.048439:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 61 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.048461:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b19b expref: 61 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.048488:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:3.0:1788833174.048493:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.048501:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.048509:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.048547:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833174.048658:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+60:2357:x1875727256478976:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 252us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833174.048666:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 81 00010000:00010000:0.0:1788833174.048890:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.048898:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833174.048913:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788833174.049073:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.049089:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.049096:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:0.0:1788833174.049098:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788833174.049101:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b200, rc 0) 00000100:00100000:0.0:1788833174.049126:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11611:x1875727256478720:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 10392us (10676us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788833174.049143:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 212 00000100:00100000:0.0:1788833174.052354:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.052577:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256479232 00000100:00100000:1.0:1788833174.052588:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256479232 00000100:00100000:1.0:1788833174.052655:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:1.0:1788833174.052666:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11611:x1875727256479232:12345-192.168.206.55@tcp:103:lfs.0 00010000:00010000:1.0:1788833174.052682:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833174.052706:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dde00/0x8c08e876ed3ff7af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b186 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.052726:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833174.052732:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833174.052835:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+59:11611:x1875727256479232:12345-192.168.206.55@tcp:103:lfs.0 Request processed in 171us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.052845:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:1.0:1788833174.055294:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.055436:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256479360 00000100:00100000:0.0:1788833174.055447:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256479360 00000100:00100000:0.0:1788833174.055658:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 213 00000100:00100000:0.0:1788833174.055670:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+59:11611:x1875727256479360:12345-192.168.206.55@tcp:58:lfs.0 00010000:00010000:0.0:1788833174.055896:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.055914:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.055925:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833174.056298:0:11926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788833174.056591:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+59:11611:x1875727256479360:12345-192.168.206.55@tcp:58:lfs.0 Request processed in 921us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833174.056600:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 213 00000100:00100000:0.0:1788833174.060090:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833174.060296:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256479488 00000100:00100000:3.0:1788833174.060321:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256479488 00000100:00100000:3.0:1788833174.060400:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 214 00000100:00100000:3.0:1788833174.060413:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+59:11611:x1875727256479488:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833174.060438:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833174.060459:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1b7 expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.060551:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.060564:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 60 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.060588:0:8616:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.060603:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 60 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.060617:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:3.0:1788833174.060620:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788833174.060624:0:8616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 60 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.060631:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dc600, rc 0) 00000100:00100000:3.0:1788833174.060700:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11611:x1875727256479488:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 290us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833174.060707:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 214 00000100:00100000:2.0:1788833174.125499:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265901824:0@lo:400:kworker.0 00000100:00100000:2.0:1788833174.125584:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833174.125649:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265902336:0@lo:400:kworker.0 00000100:00100000:2.0:1788833174.125676:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833174.125709:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833174.125714:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265901952:0@lo:400:kworker.0 00000100:00100000:2.0:1788833174.125737:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833174.125788:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265902336 00000100:00100000:1.0:1788833174.125982:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265902080:0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126028:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833174.126073:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788833174.126080:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265901696:0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126106:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833174.126126:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265902208:0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126145:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833174.126168:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265902080 00000100:00100000:1.0:1788833174.126172:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265902080 00000100:00100000:1.0:1788833174.126242:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788833174.126252:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875727265902080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126302:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875727265902080:12345-0@lo:400:kworker.0 Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.126309:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788833174.126332:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265901696 00000100:00100000:1.0:1788833174.126336:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265901696 00000100:00100000:1.0:1788833174.126372:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788833174.126380:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265901696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126409:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265901696:12345-0@lo:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.126415:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1788833174.126441:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833174.126471:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265901696:0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126495:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265902080:0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126548:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265901824 00000100:00100000:1.0:1788833174.126552:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265901824 00000100:00100000:1.0:1788833174.126575:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265901952 00000100:00100000:1.0:1788833174.126578:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265901952 00000100:00080000:1.0:1788833174.126592:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833174.126609:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265902208 00000100:00100000:1.0:1788833174.126612:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265902208 00000100:00080000:1.0:1788833174.126623:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833174.126639:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788833174.126646:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265901824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126682:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265901824:12345-0@lo:400:kworker.0 Request processed in 37us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.126688:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788833174.126700:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788833174.126706:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265901952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.126732:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265901952:12345-0@lo:400:kworker.0 Request processed in 27us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.126739:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788833174.126750:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788833174.126755:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265902208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.127284:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265902208:12345-0@lo:400:kworker.0 Request processed in 526us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.127292:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788833174.127324:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265902208:0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.127491:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265901952:0@lo:400:kworker.0 00000100:00100000:1.0:1788833174.127533:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265901824:0@lo:400:kworker.0 00000100:00100000:2.0:1788833174.131544:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265902336 00000100:00100000:2.0:1788833174.131683:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788833174.131695:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265902336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833174.131808:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265902336:12345-0@lo:400:kworker.0 Request processed in 105us (6119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.131816:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788833174.132871:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833174.133007:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265902336:0@lo:400:kworker.0 00000040:00080000:0.0:1788833174.317349:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788833174.317359:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788833174.317427:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788833174.317434:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788833174.317568:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902911880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265902464:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788833174.317695:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833174.322956:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.323269:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256479616 00000100:00100000:2.0:1788833174.323280:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256479616 00000100:00100000:2.0:1788833174.323347:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 215 00000100:00100000:2.0:1788833174.323358:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256479616:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788833174.323388:0:5813:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788833174.323490:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256479616:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 134us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.323499:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 215 00000100:00100000:1.0:1788833174.323602:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902911880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265902464:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788833174.331725:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.332295:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256479744 00000100:00100000:0.0:1788833174.332331:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256479744 00000100:00100000:0.0:1788833174.332404:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 216 00000100:00100000:0.0:1788833174.332414:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11613:x1875727256479744:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.332494:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332511:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332531:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332583:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332592:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332599:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332624:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332632:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332638:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833174.332673:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788833174.332678:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833174.332695:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332706:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332711:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332718:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332723:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833174.332727:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332734:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332746:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:0.0:1788833174.332749:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833174.332754:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332826:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff86c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332967:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332974:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332980:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.332993:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925bc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833174.332997:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333002:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333011:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9cea08db1c00) 00010000:00010000:0.0:1788833174.333014:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833174.333017:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333023:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925bc00/0x8c08e876ed3ff873 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333072:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333078:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333084:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333088:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833174.333091:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333096:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333114:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:0.0:1788833174.333116:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833174.333119:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.333124:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff87a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.333199:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11613:x1875727256479744:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 Request processed in 785us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833174.333207:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 216 00000100:00100000:3.0:1788833174.339086:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.339168:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256480000 00000100:00100000:0.0:1788833174.339177:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256480000 00000100:00100000:0.0:1788833174.339232:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 217 00000100:00100000:0.0:1788833174.339242:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+60:11613:x1875727256480000:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.339260:0:8616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833174.339277:0:8616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff881 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1be expref: -99 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339381:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339395:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339407:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833174.339417:0:8616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788833174.339541:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339549:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339555:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339561:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833174.339565:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339572:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339585:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:0.0:1788833174.339588:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788833174.339592:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339598:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339638:0:8616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff881 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1be expref: 62 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339649:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:0.0:1788833174.339651:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833174.339654:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff881 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1be expref: 62 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.339676:0:8616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b800, rc 0) 00000100:00100000:0.0:1788833174.340063:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256480000:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 820us (985us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1788833174.340072:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 217 00000100:00100000:2.0:1788833174.349092:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.349185:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256480128 00000100:00100000:1.0:1788833174.349195:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256480128 00000100:00100000:1.0:1788833174.349255:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 218 00000100:00100000:1.0:1788833174.349266:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256480128:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788833174.349298:0:5813:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788833174.349398:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256480128:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.349406:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 218 00000100:00100000:1.0:1788833174.356113:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.356221:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256480384 00000100:00100000:0.0:1788833174.356230:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256480384 00000100:00100000:0.0:1788833174.356289:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 219 00000100:00100000:0.0:1788833174.356299:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256480384:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.356319:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833174.356323:0:11926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788833174.356348:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036600/0x8c08e876ed3ff826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1a2 expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.356374:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833174.356379:0:11926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833174.356394:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff896 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1c5 expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788833174.356823:0:11926:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788833174.357019:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff89d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.357080:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.357092:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.357153:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff896 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1c5 expref: 63 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.357169:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff89d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1c5 expref: 62 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.357177:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1c00) 00010000:00010000:0.0:1788833174.357180:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833174.357182:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a000, rc 0) 00000100:00100000:0.0:1788833174.357247:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11613:x1875727256480384:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 949us (1143us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788833174.357255:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 219 00000100:00100000:3.0:1788833174.371835:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.371949:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256480640 00000100:00100000:1.0:1788833174.371959:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256480640 00000100:00100000:1.0:1788833174.372017:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 220 00000100:00100000:1.0:1788833174.372055:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11613:x1875727256480640:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788833174.372114:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833174.372141:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a000/0x8c08e876ed3ff89d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1c5 expref: 62 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372160:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1c00) 00010000:00010000:1.0:1788833174.372170:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833174.372191:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372205:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372231:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372290:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372299:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372305:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372371:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372378:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372383:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372389:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833174.372394:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372402:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372410:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833174.372413:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833174.372417:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372430:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac000/0x8c08e876ed3ff8ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372442:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372447:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372453:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372458:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833174.372461:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372467:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372475:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7061fc9f (ffff9cea0884e800) 00010000:00010000:1.0:1788833174.372483:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833174.372485:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.372491:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad200/0x8c08e876ed3ff8b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7061fc9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.372579:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256480640:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 552us (753us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788833174.372587:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 220 00000100:00100000:2.0:1788833174.375698:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.375791:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256480768 00000100:00100000:0.0:1788833174.375801:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256480768 00000100:00100000:0.0:1788833174.375859:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 221 00000100:00100000:0.0:1788833174.375869:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+61:11613:x1875727256480768:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.375886:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833174.375907:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.375938:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.375949:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.375960:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.376100:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 63 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.376117:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.376125:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833174.376129:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788833174.376132:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a200, rc 0) 00000100:00100000:0.0:1788833174.376190:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11613:x1875727256480768:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 323us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833174.376198:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 221 00000100:00100000:3.0:1788833174.383086:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.383604:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256481024 00000100:00100000:0.0:1788833174.383614:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256481024 00000100:00100000:0.0:1788833174.383677:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 222 00000100:00100000:0.0:1788833174.383686:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+62:11613:x1875727256481024:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.383759:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.383774:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.383784:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833174.384002:0:8616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788833174.384011:0:8616:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308449979523ns, next at 309449977526ns, rc = 0 00000004:00010000:0.0:1788833174.384140:0:8616:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5259438 reply state 0000000068fd6973 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.384149:0:8616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833174.384232:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+64:11613:x1875727256481024:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 546us (1154us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788833174.384239:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 222 00010000:00010000:2.0:1788833174.391149:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.391166:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.391174:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.391180:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833174.391185:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.391212:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.391227:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:2.0:1788833174.391230:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788833174.391235:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.391241:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b800/0x8c08e876ed3ff8c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833174.393868:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.393953:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256481152 00000100:00100000:2.0:1788833174.393963:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256481152 00000100:00100000:2.0:1788833174.394023:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 223 00000100:00100000:2.0:1788833174.394067:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+63:11613:x1875727256481152:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833174.394092:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833174.394112:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1d3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.394176:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 64 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.394190:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 64 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.394209:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:2.0:1788833174.394212:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833174.394216:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037200, rc 0) 00000100:00100000:2.0:1788833174.394301:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+64:11613:x1875727256481152:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 268us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.394309:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 223 00000100:00100000:3.0:1788833174.402907:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.403018:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256481280 00000100:00100000:1.0:1788833174.403028:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256481280 00000100:00100000:1.0:1788833174.403122:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:1.0:1788833174.403133:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256481280:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788833174.403441:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+10:2357:x1875727256481280:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 308us (542us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788833174.403449:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:3.0:1788833174.406679:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.406788:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256481536 00000100:00100000:2.0:1788833174.406809:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256481536 00000100:00100000:2.0:1788833174.406869:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:2.0:1788833174.406879:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+64:11613:x1875727256481536:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788833174.407140:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+65:11613:x1875727256481536:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 262us (472us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788833174.407147:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:0.0:1788833174.409780:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.409977:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256481792 00000100:00100000:2.0:1788833174.409986:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256481792 00000100:00100000:2.0:1788833174.410064:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 224 00000100:00100000:2.0:1788833174.410073:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+65:11613:x1875727256481792:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833174.410166:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+65:11613:x1875727256481792:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 94us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.410174:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 224 00000100:00100000:1.0:1788833174.418668:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833174.418761:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256481920 00000100:00100000:3.0:1788833174.418771:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256481920 00000100:00100000:3.0:1788833174.418843:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 225 00000100:00100000:3.0:1788833174.418854:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+65:11613:x1875727256481920:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833174.418877:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833174.418899:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff8d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1da expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.418964:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff8dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.418979:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.418989:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833174.419024:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833174.419087:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.419111:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dca00/0x8c08e876ed3ff8d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1da expref: 67 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.419143:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff8dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1da expref: 66 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.419152:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:3.0:1788833174.419155:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788833174.419158:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dd200, rc 0) 00000100:00100000:3.0:1788833174.419208:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+66:11613:x1875727256481920:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 355us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833174.419215:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 225 00000100:00100000:3.0:1788833174.426117:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.426267:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256482048 00000100:00100000:2.0:1788833174.426277:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256482048 00000100:00100000:2.0:1788833174.426333:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:2.0:1788833174.426343:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+10:2357:x1875727256482048:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833174.426361:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833174.426390:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1e1 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788833174.426418:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6d96, blocks: 0x1 00010000:00010000:2.0:1788833174.426450:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=308s v=(0 0) 00010000:00010000:2.0:1788833174.426454:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833174.426464:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 11 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.426484:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 11 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.426498:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036a00, rc 0) 00000100:00100000:2.0:1788833174.426569:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+11:2357:x1875727256482048:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 228us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.426576:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:0.0:1788833174.430681:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.430998:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256482304 00000100:00100000:2.0:1788833174.431007:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256482304 00000100:00100000:2.0:1788833174.431083:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 226 00000100:00100000:2.0:1788833174.431094:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+66:11613:x1875727256482304:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833174.431198:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+66:11613:x1875727256482304:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 106us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.431206:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 226 00000100:00100000:3.0:1788833174.441645:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.442080:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256482432 00000100:00100000:2.0:1788833174.442090:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256482432 00000100:00100000:2.0:1788833174.442147:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:2.0:1788833174.442156:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+11:11613:x1875727256482432:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833174.442173:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833174.442191:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1e8 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.442242:0:6654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 12 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.442251:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833174.442255:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833174.442261:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 12 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.442293:0:6654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 12 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.442306:0:6654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 12 pid: 6655 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833174.442319:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f376680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1875727265902592:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833174.442482:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788833174.458092:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f376680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6654:1875727265902592:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833174.458126:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 12 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.458148:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037000, rc 0) 00000100:00100000:2.0:1788833174.458210:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+12:11613:x1875727256482432:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 16055us (16576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.458218:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:3.0:1788833174.459230:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.459417:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256482560 00000100:00100000:1.0:1788833174.459425:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256482560 00010000:00010000:1.0:1788833174.459465:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 12 pid: 6655 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.459507:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00100000:1.0:1788833174.459527:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+12:2357:x1875727256482560:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833174.459540:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833174.459563:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 12 pid: 6655 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.459575:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 12 pid: 6655 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.459596:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019e942cf/0x8c08e876ed3ff8e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e1 expref: 12 pid: 6655 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.459611:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833174.459624:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833174.459632:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.459642:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.459675:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 11 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.459689:0:8413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8413:1875727265902720:192.168.206.55@tcp:105: 00000100:00100000:1.0:1788833174.459752:0:8413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea397df780 going to sleep for 11 seconds 00000100:00100000:1.0:1788833174.463076:0:8413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8413:1875727265902720:192.168.206.55@tcp:105: 00010000:00010000:1.0:1788833174.463102:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833174.463152:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+11:2357:x1875727256482560:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 3637us (3927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.463162:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00100000:2.0:1788833174.465271:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.465342:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256482688 00000100:00100000:1.0:1788833174.465351:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256482688 00002000:00100000:1.0:1788833174.465409:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9cea1f376680 x1875727256482688/t0(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:360/0 lens 504/0 e 0 to 0 dl 1788833185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788833174.465418:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1f376680 with x1875727256482688 ext(0->12) 00002000:00010000:1.0:1788833174.465424:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea1f376680 00000100:00100000:1.0:1788833174.465460:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:1.0:1788833174.465478:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+11:2358:x1875727256482688:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788833174.469187:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:2358:x1875727256482688:12345-192.168.206.55@tcp:4:lhsmtool_posix.0 Request processed in 3698us (3910us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788833174.469202:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00002000:00100000:1.0:1788833174.469217:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9cea1f376680 x1875727256482688/t4294967320(0) o4->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:360/0 lens 504/448 e 0 to 0 dl 1788833185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788833174.469228:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea1f376680 with x1875727256482688 ext(0->12) 00002000:00010000:1.0:1788833174.469234:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea1f376680 00000100:00100000:2.0:1788833174.478635:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.481760:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256482816 00000100:00100000:0.0:1788833174.481775:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256482816 00000100:00100000:0.0:1788833174.481929:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 227 00000100:00100000:0.0:1788833174.481941:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+66:11613:x1875727256482816:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.510565:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833174.552477:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788833174.552492:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788833174.552534:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788833174.552546:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cea3fc7f780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788833174.552550:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea40f07200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cea3fc7f840 00000020:00080000:0.0:1788833174.552554:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea40f07e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea3f719800 00000004:00080000:0.0:1788833174.552583:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788833174.552596:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cea397df900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788833174.552599:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f643800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cea397df300 00000020:00080000:0.0:1788833174.552601:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea3f643300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea40e99c00 00000001:00080000:0.0:1788833174.552612:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:0.0:1788833174.552628:0:5835:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1788833174.552815:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+20:11613:x1875727256482816:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 Request processed in 70871us (74183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.552827:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 227 00000020:00080000:2.0:1788833174.552912:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788833174.554094:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788833174.554321:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265903104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788833174.554444:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833174.554620:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833174.554629:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265902976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788833174.554654:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833174.554739:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265902848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788833174.554748:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265903104 00000100:00100000:0.0:1788833174.554756:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265903104 00000100:00100000:1.0:1788833174.554773:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833174.554803:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265902976 00000100:00100000:0.0:1788833174.554807:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265902976 00000100:00100000:0.0:1788833174.554823:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265902848 00000100:00100000:0.0:1788833174.554826:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265902848 00000100:00100000:1.0:1788833174.554836:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788833174.554855:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265903104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788833174.554878:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00002000:00080000:1.0:1788833174.554886:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:0.0:1788833174.554892:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265902976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788833174.554921:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f6d95, atime: 0x6a9f6d95, ctime: 0x6a9f6d95, blocks: 0x1 00010000:00010000:1.0:1788833174.554929:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.554945:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1788833174.554949:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833174.554955:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.554969:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.554989:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.554996:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.555016:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788833174.555137:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788833174.555141:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788833174 00002000:00010000:0.0:1788833174.555155:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788833174.555158:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788833174 -> 1788833174 00002000:00010000:0.0:1788833174.555160:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788833174.555210:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3279:x1875727265902976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (554us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788833174.555218:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788833174.555386:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788833174.555394:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265902848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788833174.555409:0:6655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788833174.555423:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.555439:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.555447:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788833174.555451:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833174.555455:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.555483:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3279:x1875727265903104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 631us (1038us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788833174.555491:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1788833174.555504:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.555530:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 12 pid: 8426 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.555543:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f110a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265903232:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833174.555611:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1788833174.555652:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833174.555660:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.555669:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833174.555674:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.555684:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.555701:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.555708:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ff8f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.555732:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833174.555734:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833174.555736:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788833174.556992:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea1f375180/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788833174.557006:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265902976:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1788833174.557028:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea1f376a00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788833174.557048:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265903104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788833174.558706:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.559877:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.560138:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f110a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265903232:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833174.560173:0:6655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833174.560474:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256483072 00000100:00100000:3.0:1788833174.560482:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256483072 00010000:00010000:3.0:1788833174.560516:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 13 pid: 8426 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833174.560561:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:3.0:1788833174.560569:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+13:2357:x1875727256483072:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833174.560582:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833174.560587:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 13 pid: 8426 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.560598:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 13 pid: 8426 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.560636:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ff6b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b147 expref: 13 pid: 8426 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.560650:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833174.560654:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833174.560659:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.560669:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.560696:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833174.560742:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+12:2357:x1875727256483072:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 174us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833174.560750:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:1.0:1788833174.561046:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256482944 00000100:00100000:1.0:1788833174.561051:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256482944 00000100:00100000:1.0:1788833174.561085:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:1.0:1788833174.561093:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+12:2358:x1875727256482944:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.561207:0:6655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.561218:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.561295:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.561304:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.561330:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788833174.561892:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3277:x1875727265902848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6498us (7118us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788833174.561909:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788833174.562726:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833174.562735:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.562748:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ae00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833174.562753:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.562764:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.562781:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.562790:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000916f0fd6/0x8c08e876ed3ff8f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.562815:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833174.562823:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833174.562825:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788833174.563296:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea1f375f80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788833174.563304:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265902848:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788833174.622570:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1788833174.622590:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788833174.624055:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256482944:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 Request processed in 62937us (65331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.624068:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:0.0:1788833174.631486:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.631652:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256483328 00000100:00100000:2.0:1788833174.631662:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256483328 00000100:00100000:2.0:1788833174.631734:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 228 00000100:00100000:2.0:1788833174.631745:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+20:11613:x1875727256483328:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788833174.631814:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833174.631853:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd200/0x8c08e876ed3ff8dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1da expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.631876:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:2.0:1788833174.631881:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833174.631910:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.631924:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.631934:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833174.632231:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033b4ea72 reply state 00000000dc3e2096 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833174.632242:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833174.632349:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:11613:x1875727256483328:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 606us (874us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788833174.632356:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 228 00010000:00010000:3.0:1788833174.634086:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.634102:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.634111:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.634117:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833174.634121:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.634146:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.634161:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:3.0:1788833174.634164:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833174.634169:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833174.634175:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036000/0x8c08e876ed3ff8ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.634787:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.634878:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256483456 00000100:00100000:2.0:1788833174.634886:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256483456 00000100:00100000:2.0:1788833174.634940:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:2.0:1788833174.634950:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256483456:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788833174.635217:0:6654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788833174.635221:0:6654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788833174 -> 1788833173 00002000:00010000:2.0:1788833174.635223:0:6654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788833173 00002000:00010000:2.0:1788833174.635236:0:6654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788833174 -> 1788833173 00002000:00010000:2.0:1788833174.635238:0:6654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788833174.635359:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256483456:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 410us (575us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788833174.635368:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:2.0:1788833174.638360:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265903360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833174.638425:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833174.640167:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265903360 00000100:00100000:0.0:1788833174.640180:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265903360 00000100:00100000:2.0:1788833174.640294:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265903488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833174.640349:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833174.643794:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.646816:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265903488 00000100:00100000:0.0:1788833174.646840:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265903488 00000100:00100000:0.0:1788833174.646876:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256483712 00000100:00100000:0.0:1788833174.646879:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256483712 00000100:00100000:0.0:1788833174.646945:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 229 00000100:00100000:1.0:1788833174.646949:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788833174.646956:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+20:11613:x1875727256483712:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 00000100:00100000:1.0:1788833174.646959:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875727265903360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833174.646980:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00010000:00010000:0.0:1788833174.647013:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.647047:0:11926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.647056:0:11926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.647095:0:11926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.647108:0:11926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 20 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.647122:0:11926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265903616:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833174.647150:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875727265903360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (8725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.647157:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788833174.647213:0:11926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788833174.647269:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788833174.647276:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3277:x1875727265903488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833174.647287:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833174.647320:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3277:x1875727265903488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (6971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833174.647326:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788833174.647353:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265903488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833174.647554:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788833174.647561:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788833174.647575:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea1f375180, transno 4294967321 00000100:00100000:2.0:1788833174.647597:0:3276:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9cea1f375f80 x1875727265902848/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788833190 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833174.647613:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265903360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833174.649973:0:11926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265903616:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833174.650001:0:11926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833174.651070:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.654801:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256483840 00000100:00100000:2.0:1788833174.654817:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256483840 00010000:00010000:2.0:1788833174.654868:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 21 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833174.654919:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00100000:2.0:1788833174.654930:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:2358:x1875727256483840:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833174.654944:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833174.654951:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 21 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.654981:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 21 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.655003:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff8c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1cc expref: 21 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.655020:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:2.0:1788833174.655025:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.655084:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.655092:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.655123:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833174.655191:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+20:2358:x1875727256483840:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 262us (4161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.655198:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 84 00010000:00010000:0.0:1788833174.655536:0:11926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655545:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655572:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655579:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655586:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655591:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833174.655595:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655603:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655613:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:0.0:1788833174.655623:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788833174.655628:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.655635:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff906 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.655691:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11613:x1875727256483712:12345-192.168.206.55@tcp:55:lhsmtool_posix.0 Request processed in 8735us (11905us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788833174.655700:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 229 00000100:00100000:3.0:1788833174.657906:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.658010:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256483968 00000100:00100000:0.0:1788833174.658018:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256483968 00000100:00100000:0.0:1788833174.658097:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:0.0:1788833174.658108:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2357:x1875727256483968:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788833174.658151:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.658171:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 8 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.658180:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833174.658184:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788833174.658189:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.658224:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 8 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.658257:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 8 pid: 6654 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.658272:0:6655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265903744:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833174.658353:0:6655:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833174.664402:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.664535:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256484096 00000100:00100000:1.0:1788833174.664546:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256484096 00010000:00010000:1.0:1788833174.664588:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 9 pid: 6654 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.664634:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 85 00000100:00100000:1.0:1788833174.664644:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256484096:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833174.664658:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833174.664681:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 9 pid: 6654 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.664714:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 9 pid: 6654 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.664741:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833174.664746:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788833174.664753:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.664764:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.664785:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833174.664844:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+9:2357:x1875727256484096:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 201us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833174.664851:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 85 00010000:00010000:0.0:1788833174.664960:0:6655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392b8afc/0x8c08e876ed3ff8ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1e8 expref: 8 pid: 6654 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.664975:0:6655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6655:1875727265903744:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833174.664999:0:6655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665011:0:6655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665019:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665068:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665079:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665102:0:6655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665110:0:6655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833174.665115:0:6655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665125:0:6655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665140:0:6655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.665149:0:6655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006594467f/0x8c08e876ed3ff90d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.665211:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2357:x1875727256483968:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 Request processed in 7105us (7313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833174.665219:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:3.0:1788833174.667724:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.667832:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256484352 00000100:00100000:1.0:1788833174.667841:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256484352 00000100:00100000:1.0:1788833174.667903:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 230 00000100:00100000:1.0:1788833174.667913:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11613:x1875727256484352:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788833174.668003:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.668021:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.668071:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.668503:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.668515:0:8616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.668533:0:8616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.668567:0:8616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.668582:0:8616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 20 pid: 5813 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.668596:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265903872:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833174.668690:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea033933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833174.672158:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.672286:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256484480 00000100:00100000:2.0:1788833174.672295:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256484480 00010000:00010000:2.0:1788833174.672332:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 21 pid: 5813 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833174.672378:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 86 00000100:00100000:2.0:1788833174.672388:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:2358:x1875727256484480:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833174.672421:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833174.672428:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 21 pid: 5813 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.672441:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 21 pid: 5813 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.672461:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:2.0:1788833174.672467:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.672477:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.672484:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.672501:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833174.672564:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+21:2358:x1875727256484480:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 177us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.672572:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 86 00010000:00010000:1.0:1788833174.673236:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037200/0x8c08e876ed3ff8ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1d3 expref: 20 pid: 5813 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.673254:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265903872:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833174.673275:0:8616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.673282:0:8616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.673287:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788833174.673464:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788833174.673611:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1788833174.673657:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788833174.673750:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265904000:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788833174.673796:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833174.673831:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea07f0b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788833174.673878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265904000 00000100:00100000:0.0:1788833174.673885:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265904000 00000100:00100000:0.0:1788833174.673931:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788833174.673940:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8616:x1875727265904000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788833174.674023:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8616:x1875727265904000:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833174.674076:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788833174.674089:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265904000:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788833174.674498:0:8616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788833174.674560:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f374700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265904128:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788833174.674589:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833174.674617:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788833174.674675:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265904128 00000100:00100000:0.0:1788833174.674679:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265904128 00000100:00100000:0.0:1788833174.674703:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788833174.674710:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8616:x1875727265904128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788833174.674858:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8616:x1875727265904128:12345-0@lo:1000:mdt00_003.0 Request processed in 148us (267us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788833174.674865:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788833174.674930:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f374700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8616:1875727265904128:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788833174.674966:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.674981:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.674989:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.674995:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833174.674999:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675007:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675022:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea08db1400) 00010000:00010000:2.0:1788833174.675025:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833174.675062:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675069:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad600/0x8c08e876ed3ff91b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675101:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675107:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675114:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675119:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833174.675129:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675135:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675144:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833174.675147:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833174.675153:0:8616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 23 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675165:0:8616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 23 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675174:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 23 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.675199:0:8616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 23 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833174.675210:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f375180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265904256:192.168.206.55@tcp:105: 00000100:00100000:2.0:1788833174.675273:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f27d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788833174.679190:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f375180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8616:1875727265904256:192.168.206.55@tcp:105: 00010000:00010000:2.0:1788833174.679225:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679236:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff85e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679283:0:8616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679297:0:8616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679307:0:8616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679317:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679324:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679330:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679335:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036800 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833174.679338:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679344:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679355:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833174.679358:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833174.679362:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679367:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f036800/0x8c08e876ed3ff922 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679384:0:8616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679390:0:8616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679396:0:8616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679401:0:8616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833174.679404:0:8616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679410:0:8616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679418:0:8616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833174.679420:0:8616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788833174.679422:0:8616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.679428:0:8616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad000/0x8c08e876ed3ff914 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833174.679700:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+23:11613:x1875727256484352:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 11786us (11984us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788833174.679709:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 230 00000020:00080000:2.0:1788833174.679715:0:8616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788833174.680095:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.681204:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256484608 00000100:00100000:2.0:1788833174.681215:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256484608 00000100:00100000:2.0:1788833174.681295:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:2.0:1788833174.681303:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+23:11611:x1875727256484608:12345-192.168.206.55@tcp:49:lfs.0 00000100:00100000:2.0:1788833174.681433:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+23:11611:x1875727256484608:12345-192.168.206.55@tcp:49:lfs.0 Request processed in 130us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.681440:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:3.0:1788833174.682411:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.682550:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256484864 00000100:00100000:2.0:1788833174.682558:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256484864 00000100:00100000:2.0:1788833174.682605:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:2.0:1788833174.682613:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af08c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+23:11613:x1875727256484864:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788833174.683502:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788833174.683621:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1788833174.683667:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.683682:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.683693:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.683701:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.683707:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.683714:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833174.683774:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788833174.683885:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af08c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+25:11613:x1875727256484864:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 1269us (1477us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788833174.683894:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 62 00000020:00080000:2.0:1788833174.683898:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788833174.686711:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788833174.686721:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833174.687387:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788833174.687398:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788833174.687658:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833174.687668:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.687678:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833174.687682:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.687691:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.687706:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cea1539cb00) 00010000:00010000:0.0:1788833174.687709:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788833174.687714:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.687720:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037a00/0x8c08e876ed3ff929 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.687737:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833174.687739:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833174.687741:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833174.693077:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833174.693181:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256485120 00000100:00100000:2.0:1788833174.693193:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256485120 00000100:00100000:2.0:1788833174.693252:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 231 00000100:00100000:2.0:1788833174.693262:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+25:11611:x1875727256485120:12345-192.168.206.55@tcp:58:lfs.0 00000040:00080000:2.0:1788833174.693549:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788833174.693645:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+25:11611:x1875727256485120:12345-192.168.206.55@tcp:58:lfs.0 Request processed in 383us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833174.693653:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 231 00000100:00100000:3.0:1788833174.736413:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.736577:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256485248 00000100:00100000:0.0:1788833174.736587:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256485248 00000100:00100000:0.0:1788833174.736652:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 232 00000100:00100000:0.0:1788833174.736662:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+25:11615:x1875727256485248:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833174.736685:0:11926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833174.736705:0:11926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1ef expref: -99 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.736769:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.736784:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.736795:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.736808:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.736815:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.736821:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.737133:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.737145:0:11926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.737165:0:11926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.737200:0:11926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.737214:0:11926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 26 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833174.737229:0:11926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265904384:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833174.737323:0:11926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833174.740807:0:11926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11926:1875727265904384:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833174.740841:0:11926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833174.741856:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833174.742012:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256485504 00000100:00100000:0.0:1788833174.742019:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256485504 00000100:00100000:0.0:1788833174.742116:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:0.0:1788833174.742127:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+27:5597:x1875727256485504:12345-192.168.206.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788833174.742345:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+28:5597:x1875727256485504:12345-192.168.206.55@tcp:35:ldlm_bl.0 Request processed in 220us (492us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788833174.742354:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:0.0:1788833174.748806:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833174.751499:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256485632 00000100:00100000:1.0:1788833174.751514:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256485632 00010000:00010000:1.0:1788833174.751581:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 28 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.751631:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 87 00000100:00100000:1.0:1788833174.751641:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+28:2358:x1875727256485632:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833174.751655:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833174.751662:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 28 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.751675:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 28 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.751711:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ff850 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b0 expref: 28 pid: 5811 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.751726:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833174.751731:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.751741:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.751748:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833174.751782:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833174.751847:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+27:2358:x1875727256485632:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 206us (3118us total) trans 0 rc 0/0 00010000:00010000:0.0:1788833174.751849:0:11926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833174.751858:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 87 00010000:00010000:0.0:1788833174.751865:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833174.751909:0:11926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788833174.751921:0:11926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833174.751947:0:11926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.751962:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.751971:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.751978:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.751986:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.751991:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833174.751995:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752001:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752010:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:0.0:1788833174.752013:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833174.752016:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752021:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3ff937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752118:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752136:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752142:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752148:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833174.752151:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752158:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752167:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cea08db1700) 00010000:00010000:0.0:1788833174.752170:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833174.752173:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752178:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ff93e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752214:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ff930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1ef expref: 27 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752227:0:11926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1ef expref: 26 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833174.752234:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:0.0:1788833174.752237:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833174.752245:0:11926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a200, rc 0) 00000100:00100000:0.0:1788833174.752274:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11615:x1875727256485248:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 15613us (15870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833174.752281:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 232 00010000:00010000:1.0:1788833175.533675:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788833175.657476:0:12529:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788833175.657486:0:12529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788833175.657544:0:12529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788833175.657551:0:12529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788833175.729398:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788833175.729409:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788833175.729448:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788833175.729578:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788833175.729697:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265904512:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788833175.729836:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788833175.739021:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11651:1875727265904512:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788833175.741431:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833175.741765:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256485760 00000100:00100000:0.0:1788833175.741775:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256485760 00000100:00100000:0.0:1788833175.741852:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 233 00000100:00100000:0.0:1788833175.741863:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11627:x1875727256485760:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788833175.741897:0:8616:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788833175.741997:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11627:x1875727256485760:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 136us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833175.742006:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 233 00000100:00080000:1.0:1788833175.742153:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833175.745522:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833175.745575:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256486016 00000100:00100000:1.0:1788833175.745585:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256486016 00000100:00100000:1.0:1788833175.745642:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 234 00000100:00100000:1.0:1788833175.745653:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+26:11627:x1875727256486016:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833175.745670:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833175.745689:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff94c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1f6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.745783:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.745823:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.745833:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833175.745845:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788833175.745968:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fade00/0x8c08e876ed3ff94c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1f6 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.745986:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1f6 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.745993:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833175.745996:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833175.745998:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02fac800, rc 0) 00000100:00100000:1.0:1788833175.746081:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+28:11627:x1875727256486016:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 429us (577us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788833175.746088:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 234 00000100:00100000:3.0:1788833175.753878:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833175.753930:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833175.754011:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256486144 00000100:00100000:0.0:1788833175.754021:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256486144 00000100:00100000:1.0:1788833175.754082:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256486400 00000100:00100000:1.0:1788833175.754087:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256486400 00000100:00100000:0.0:1788833175.754091:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:0.0:1788833175.754104:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+29:2359:x1875727256486144:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833175.754118:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788833175.754129:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 235 00000100:00100000:1.0:1788833175.754139:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+29:11627:x1875727256486400:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788833175.754156:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac800/0x8c08e876ed3ff953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1f6 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833175.754173:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:0.0:1788833175.754178:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833175.754205:0:11926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.754221:0:11926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833175.754234:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+28:2359:x1875727256486144:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 132us (364us total) trans 0 rc 0/0 00010000:00010000:1.0:1788833175.754244:0:11926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833175.754244:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 18 00010000:00010000:1.0:1788833175.754482:0:11926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.754491:0:11926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.754497:0:11926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.754503:0:11926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833175.754507:0:11926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.754524:0:11926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.754535:0:11926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833175.754537:0:11926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788833175.754541:0:11926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833175.754546:0:11926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac400/0x8c08e876ed3ff961 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833175.754676:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+28:11627:x1875727256486400:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 537us (744us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788833175.754684:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 235 00000040:00080000:3.0:1788833175.755152:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833175.755162:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833175.755711:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788833175.755720:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788833175.759859:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833175.759962:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256486656 00000100:00100000:3.0:1788833175.759972:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256486656 00000100:00100000:3.0:1788833175.760745:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:3.0:1788833175.760762:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+28:11627:x1875727256486656:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788833175.761069:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+29:11627:x1875727256486656:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 312us (1215us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788833175.769010:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 64 00010000:00010000:1.0:1788833176.557946:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833177.276471:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788833177.276497:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:0.0:1788833177.581947:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788833177.637424:0:12581:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833177.637434:0:12581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833177.637479:0:12581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788833177.637484:0:12581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788833177.843794:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833177.843909:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256486912 00000100:00100000:1.0:1788833177.843919:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256486912 00000100:00080000:2.0:1788833177.843981:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833177.843994:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 236 00000100:00100000:1.0:1788833177.844005:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+29:11647:x1875727256486912:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833177.844058:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833177.844081:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad400/0x8c08e876ed3ff968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b1fd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.844223:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff96f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.844238:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.844258:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833177.844274:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788833177.844384:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fad400/0x8c08e876ed3ff968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1fd expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.844401:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff96f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1fd expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.844436:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833177.844440:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788833177.844442:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037600, rc 0) 00000100:00100000:2.0:1788833177.844495:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+31:11647:x1875727256486912:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 492us (710us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788833177.844512:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 236 00000100:00100000:0.0:1788833177.849888:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833177.849983:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256487040 00000100:00100000:2.0:1788833177.849992:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256487040 00000100:00100000:2.0:1788833177.850068:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 237 00000100:00100000:2.0:1788833177.850078:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:11647:x1875727256487040:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:2.0:1788833177.850141:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850159:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850171:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850195:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850201:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850207:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850213:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833177.850227:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850246:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850263:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:2.0:1788833177.850266:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833177.850270:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833177.850287:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037400/0x8c08e876ed3ff97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833177.850349:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+31:11647:x1875727256487040:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 272us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833177.850362:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 237 00000100:00100000:2.0:1788833177.932990:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833177.933123:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256487168 00000100:00100000:3.0:1788833177.933133:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256487168 00000100:00100000:3.0:1788833177.933205:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 71 00000100:00100000:3.0:1788833177.933216:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2360:x1875727256487168:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:3.0:1788833177.933244:0:6654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833177.933268:0:6654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a43662/0x8c08e876ed3ff984 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b204 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788833177.933294:0:6654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f6d95, atime: 0x6a9f6d95, ctime: 0x6a9f6d95, blocks: 0xb 00010000:00010000:3.0:1788833177.933312:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1788833177.933318:0:6654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833177.933327:0:6654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a43662/0x8c08e876ed3ff984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b204 expref: 8 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833177.933365:0:6654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a43662/0x8c08e876ed3ff984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b204 expref: 8 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833177.933379:0:6654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea421dca00, rc 0) 00000100:00100000:3.0:1788833177.933433:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2360:x1875727256487168:12345-192.168.206.55@tcp:101:cat.0 Request processed in 219us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833177.933440:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 71 00000100:00080000:2.0:1788833177.933609:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833177.937322:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833177.937462:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256487296 00000100:00100000:3.0:1788833177.937475:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256487296 00002000:00100000:3.0:1788833177.937547:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9cea0674aa00 x1875727256487296/t0(0) o3->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:363/0 lens 488/0 e 0 to 0 dl 1788833188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833177.937560:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea0674aa00 with x1875727256487296 ext(0->4095) 00002000:00010000:3.0:1788833177.937566:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea0674aa00 00000100:00100000:3.0:1788833177.937607:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1788833177.937616:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2359:x1875727256487296:12345-192.168.206.55@tcp:3:cat.0 00000100:00100000:3.0:1788833177.937860:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0674aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+8:2359:x1875727256487296:12345-192.168.206.55@tcp:3:cat.0 Request processed in 243us (551us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788833177.937868:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00002000:00100000:3.0:1788833177.937874:0:6659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9cea0674aa00 x1875727256487296/t0(0) o3->458534c2-c478-4b32-bcda-93b4ecf625e9@192.168.206.55@tcp:363/0 lens 488/4536 e 0 to 0 dl 1788833188 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788833177.937883:0:6659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cea0674aa00 with x1875727256487296 ext(0->4095) 00002000:00010000:3.0:1788833177.937887:0:6659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cea0674aa00 00000100:00100000:3.0:1788833178.317288:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833178.317369:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833178.317636:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256487552 00000100:00100000:1.0:1788833178.317661:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256487552 00000100:00100000:1.0:1788833178.317745:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:1.0:1788833178.317756:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256487552:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833178.317836:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256487552:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 82us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833178.317844:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:2.0:1788833178.317927:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256487424 00000100:00100000:2.0:1788833178.317932:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256487424 00000100:00100000:2.0:1788833178.317967:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 294 00000100:00100000:2.0:1788833178.317974:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256487424:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833178.318001:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2357:x1875727256487424:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 28us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833178.318007:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 294 00000100:00080000:3.0:1788833178.318211:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833178.318402:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833178.318798:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256487680 00000100:00100000:3.0:1788833178.318803:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256487680 00000100:00100000:3.0:1788833178.318858:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 149 00000100:00100000:3.0:1788833178.318866:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256487680:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833178.318917:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+5:2357:x1875727256487680:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 52us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833178.318924:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 149 00000100:00080000:2.0:1788833178.319721:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788833178.605641:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833179.245489:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265904896:0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.245579:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833179.245633:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833179.245639:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265905024:0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.245669:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833179.245722:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265904896 00000100:00100000:1.0:1788833179.245729:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265904896 00000100:00100000:1.0:1788833179.245794:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788833179.245804:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265904896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.245855:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265904896:12345-0@lo:400:kworker.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833179.245871:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788833179.245898:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905024 00000100:00100000:1.0:1788833179.245901:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905024 00000100:00100000:1.0:1788833179.245927:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788833179.245934:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265905024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.245966:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265905024:12345-0@lo:400:kworker.0 Request processed in 33us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833179.245973:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788833179.245988:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788833179.245992:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833179.246024:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265905024:0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.246068:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265904896:0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246223:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265904768:0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246253:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833179.246279:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265905280:0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246300:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833179.246316:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788833179.246322:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265904640:0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246357:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833179.246378:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265905152:0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246399:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833179.246425:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265904768 00000100:00100000:0.0:1788833179.246429:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265904768 00000100:00100000:0.0:1788833179.246449:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905152 00000100:00100000:0.0:1788833179.246452:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905152 00000100:00100000:0.0:1788833179.246502:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788833179.246510:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265904768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246546:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265904768:12345-0@lo:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833179.246553:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788833179.246565:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788833179.246571:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3957b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265905152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246599:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3957b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265905152:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833179.246604:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788833179.246629:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265905152:0@lo:400:kworker.0 00000100:00100000:0.0:1788833179.246639:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265904768:0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.247020:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905280 00000100:00100000:1.0:1788833179.247024:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905280 00000100:00100000:1.0:1788833179.247083:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788833179.247089:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265905280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.247127:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265905280:12345-0@lo:400:kworker.0 Request processed in 39us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833179.247133:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788833179.247151:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265904640 00000100:00100000:1.0:1788833179.247155:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265904640 00000100:00100000:1.0:1788833179.247178:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788833179.247184:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265904640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.247213:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265904640:12345-0@lo:400:kworker.0 Request processed in 29us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833179.247219:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1788833179.247259:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833179.247262:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833179.247281:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265904640:0@lo:400:kworker.0 00000100:00100000:1.0:1788833179.247291:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788833179.247296:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea39215c00, transno 4294967307 00000004:00080000:1.0:1788833179.247305:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788833179.247319:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea1f376a00, transno 4294967310 00000100:00100000:1.0:1788833179.247324:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265905280:0@lo:400:kworker.0 00010000:00010000:1.0:1788833179.632581:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833179.757215:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265905408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833179.757285:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833179.757351:0:12183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905408 00000100:00100000:1.0:1788833179.757358:0:12183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905408 00000100:00100000:1.0:1788833179.757415:0:12183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788833179.757424:0:12183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265905408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833179.757457:0:12183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833179.757513:0:12183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875727265905408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833179.757520:0:12183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788833179.757566:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265905408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833179.758318:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265905536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833179.758373:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833179.758937:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905536 00000100:00100000:0.0:1788833179.758945:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905536 00000100:00100000:0.0:1788833179.758996:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788833179.759005:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1012d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265905536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788833179.759057:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833179.759109:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1012d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265905536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833179.759117:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788833179.759276:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265905536:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788833179.824617:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788833179.824636:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1788833179.859538:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:0.0:1788833179.859560:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:0.0:1788833179.859578:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788833179.859593:0:5835:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cea1f27dc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788833179.859598:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea40a10e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cea1f27da80 00000020:00080000:0.0:1788833179.859609:0:5835:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cea40a10900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cea395c7000 00000020:00080000:0.0:1788833179.859625:0:5835:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788833179.859643:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788833179.859865:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788833180.653300:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788833180.913460:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788833180.913469:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788833180.913519:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788833180.913526:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788833181.678468:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833182.702752:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833182.730673:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833182.730775:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256487808 00000100:00100000:1.0:1788833182.730786:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256487808 00000100:00100000:1.0:1788833182.730916:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 238 00000100:00100000:1.0:1788833182.730927:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11300:x1875727256487808:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788833182.731078:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11300:x1875727256487808:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833182.731101:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 238 00000100:00080000:2.0:1788833182.731325:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833182.739133:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833182.739227:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488064 00000100:00100000:1.0:1788833182.739238:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488064 00000100:00100000:1.0:1788833182.739371:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:1.0:1788833182.739382:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:11300:x1875727256488064:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788833182.739747:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:11300:x1875727256488064:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 365us (623us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788833182.739755:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:3.0:1788833183.045069:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833183.047853:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488192 00000100:00100000:1.0:1788833183.047876:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488192 00000100:00100000:1.0:1788833183.048007:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 239 00000100:00100000:1.0:1788833183.048023:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+5:12099:x1875727256488192:12345-192.168.206.55@tcp:101:lsof.0 00010000:00010000:1.0:1788833183.048074:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833183.048233:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b20b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833183.048314:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02facc00/0x8c08e876ed3ff992 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833183.048328:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02facc00/0x8c08e876ed3ff992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833183.048342:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02facc00/0x8c08e876ed3ff992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833183.048377:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788833183.048380:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833183.048691:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02facc00/0x8c08e876ed3ff992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833183.048722:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02fac600/0x8c08e876ed3ff98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b20b expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833183.048747:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02facc00/0x8c08e876ed3ff992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b20b expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833183.048757:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:1.0:1788833183.048760:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833183.048764:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea02facc00, rc 0) 00000100:00100000:1.0:1788833183.048861:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db0428-be24-4f30-b1d9-80f4991cba8f+6:12099:x1875727256488192:12345-192.168.206.55@tcp:101:lsof.0 Request processed in 841us (3840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833183.048872:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 239 00000100:00080000:2.0:1788833183.048877:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833183.440750:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833183.440797:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833183.440832:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833183.440919:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488576 00000100:00100000:3.0:1788833183.440934:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488576 00000100:00100000:1.0:1788833183.440969:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488320 00000100:00100000:1.0:1788833183.440983:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488320 00000100:00100000:3.0:1788833183.441021:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488448 00000100:00100000:3.0:1788833183.441027:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488448 00000100:00100000:1.0:1788833183.441099:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 296 00000100:00100000:1.0:1788833183.441114:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256488320:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833183.441126:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00100000:1.0:1788833183.441202:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256488320:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 93us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833183.441211:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 296 00000100:00100000:1.0:1788833183.441251:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:1.0:1788833183.441259:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256488448:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833183.441284:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256488448:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833183.441290:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:3.0:1788833183.441764:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256488576:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833183.441857:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256488576:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 721us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833183.441867:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00080000:2.0:1788833183.442020:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833183.442027:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788833183.725290:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833184.365861:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265905664:0@lo:400:kworker.0 00000100:00100000:1.0:1788833184.365943:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833184.366062:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265905792:0@lo:400:kworker.0 00000100:00100000:0.0:1788833184.366153:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833184.366293:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905792 00000100:00100000:1.0:1788833184.366303:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905792 00000100:00100000:1.0:1788833184.366360:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788833184.366371:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265905792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.367864:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905664 00000100:00100000:3.0:1788833184.367875:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905664 00000100:00100000:3.0:1788833184.367927:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788833184.367952:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265905664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368013:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3278:x1875727265905664:12345-0@lo:400:kworker.0 Request processed in 64us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833184.368019:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788833184.368093:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea27225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265906048:0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368131:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833184.368157:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788833184.368164:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea27226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265905920:0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368188:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833184.368234:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906048 00000100:00100000:3.0:1788833184.368238:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906048 00000100:00100000:3.0:1788833184.368270:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788833184.368275:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265906048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368305:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265906048:12345-0@lo:400:kworker.0 Request processed in 30us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833184.368311:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788833184.368323:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833184.368346:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788833184.368350:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea1f375f80, transno 4294967322 00000004:00080000:3.0:1788833184.368361:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788833184.368381:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea27225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265906048:0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368707:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265905920 00000100:00100000:3.0:1788833184.368712:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265905920 00000100:00100000:3.0:1788833184.368752:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788833184.368758:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265905920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368793:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265905920:12345-0@lo:400:kworker.0 Request processed in 35us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833184.368805:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788833184.368820:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833184.368835:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea27226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265905920:0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368869:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea27224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265906176:0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368896:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833184.368920:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265905664:0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.368948:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906176 00000100:00100000:3.0:1788833184.368951:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906176 00000100:00100000:3.0:1788833184.368977:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788833184.368982:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265906176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.369016:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265906176:12345-0@lo:400:kworker.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833184.369022:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1788833184.369054:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833184.369072:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea27224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265906176:0@lo:400:kworker.0 00000100:00100000:1.0:1788833184.371493:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265905792:12345-0@lo:400:kworker.0 Request processed in 5097us (5314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833184.371512:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788833184.373439:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788833184.373466:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea27224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265906304:0@lo:400:kworker.0 00000100:00100000:3.0:1788833184.373571:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833184.378648:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906304 00000100:00100000:1.0:1788833184.378670:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906304 00000100:00100000:1.0:1788833184.378799:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788833184.378812:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265906304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833184.378950:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265906304:12345-0@lo:400:kworker.0 Request processed in 141us (5378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833184.378958:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788833184.379079:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea27224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265906304:0@lo:400:kworker.0 00000100:00080000:3.0:1788833184.379702:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833184.379852:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265905792:0@lo:400:kworker.0 00010000:00010000:1.0:1788833184.755283:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833184.878717:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788833184.878747:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265906432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833184.878838:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833184.878936:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906432 00000100:00100000:3.0:1788833184.878946:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906432 00000100:00100000:3.0:1788833184.879006:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788833184.879069:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265906432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833184.879115:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833184.879171:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265906432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833184.879178:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788833184.879238:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265906432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833184.883744:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833184.883776:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265906560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833184.883872:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833184.883940:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906560 00000100:00100000:1.0:1788833184.883951:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906560 00000100:00100000:1.0:1788833184.884009:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788833184.884019:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265906560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833184.884093:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833184.884164:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265906560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833184.884174:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788833184.884231:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265906560:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1788833184.969719:0:5835:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788833184.970089:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788833184.970147:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788833184.970161:0:5846:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788833185.774843:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788833186.626941:0:12782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:06:24 (1788833184) 00010000:00010000:3.0:1788833186.797241:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833187.828462:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833188.556140:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833188.556184:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833188.556223:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833188.556247:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833188.556265:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488832 00000100:00100000:2.0:1788833188.556275:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833188.556278:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488832 00000100:00100000:2.0:1788833188.556298:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256489088 00000100:00100000:2.0:1788833188.556302:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256489088 00000100:00100000:3.0:1788833188.556467:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256489216 00000100:00100000:3.0:1788833188.556472:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256489216 00000100:00100000:0.0:1788833188.556490:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 156 00000100:00100000:0.0:1788833188.556507:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+18:2358:x1875727256488832:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833188.556618:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+18:2358:x1875727256488832:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 116us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833188.556626:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 156 00000100:00100000:0.0:1788833188.556858:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488960 00000100:00100000:0.0:1788833188.556863:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488960 00000100:00100000:2.0:1788833188.559135:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 97 00000100:00100000:2.0:1788833188.559155:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256489088:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833188.559262:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2358:x1875727256489088:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 113us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833188.559270:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 97 00000100:00100000:1.0:1788833188.560264:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256488704 00000100:00100000:1.0:1788833188.560279:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256488704 00000100:00100000:1.0:1788833188.560337:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 298 00000100:00100000:1.0:1788833188.560347:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256488704:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1788833188.560498:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2358:x1875727256488704:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 152us (4273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833188.560505:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 298 00000100:00080000:1.0:1788833188.561123:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788833188.561131:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833188.561136:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833188.562445:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 157 00000100:00100000:3.0:1788833188.562474:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2358:x1875727256489216:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833188.562577:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2358:x1875727256489216:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 109us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833188.562586:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 157 00000100:00100000:0.0:1788833188.564347:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 98 00000100:00100000:0.0:1788833188.564367:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256488960:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1788833188.564774:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2358:x1875727256488960:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 413us (8523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833188.564784:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 98 00010000:00010000:3.0:1788833188.845409:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833189.486710:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265906816:0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.486801:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833189.486862:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265907328:0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.486884:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833189.486909:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788833189.486914:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265906688:0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.486934:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833189.486953:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265907200:0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.486972:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833189.486999:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906688 00000100:00100000:0.0:1788833189.487006:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906688 00000100:00100000:0.0:1788833189.487070:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788833189.487079:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265906688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.487126:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265906688:12345-0@lo:400:kworker.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833189.487133:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788833189.487163:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906816 00000100:00100000:0.0:1788833189.487167:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906816 00000100:00100000:0.0:1788833189.487192:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907200 00000100:00100000:0.0:1788833189.487195:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907200 00000100:00100000:0.0:1788833189.487224:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788833189.487231:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265906816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.487258:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265906816:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833189.487263:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788833189.487273:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788833189.487279:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265907200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.487316:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265907200:12345-0@lo:400:kworker.0 Request processed in 37us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833189.487322:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788833189.487355:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265906688:0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.487368:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265907200:0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.487376:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265906816:0@lo:400:kworker.0 00000100:00100000:2.0:1788833189.487577:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265906944:0@lo:400:kworker.0 00000100:00100000:2.0:1788833189.487607:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833189.487635:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833189.487649:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea39217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265907072:0@lo:400:kworker.0 00000100:00100000:2.0:1788833189.487674:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833189.487711:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907328 00000100:00100000:2.0:1788833189.487714:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907328 00000100:00100000:2.0:1788833189.487740:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907072 00000100:00100000:2.0:1788833189.487743:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907072 00000100:00100000:2.0:1788833189.487775:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788833189.487783:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265907328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833189.487817:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265907328:12345-0@lo:400:kworker.0 Request processed in 35us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833189.487823:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788833189.487836:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788833189.487843:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265907072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833189.487875:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265907072:12345-0@lo:400:kworker.0 Request processed in 33us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833189.487881:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788833189.487899:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265906944 00000100:00100000:2.0:1788833189.487903:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265906944 00000100:00100000:2.0:1788833189.487926:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788833189.487933:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265906944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833189.487962:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265906944:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833189.487969:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788833189.487997:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265907072:0@lo:400:kworker.0 00000100:00100000:2.0:1788833189.488005:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea39216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265906944:0@lo:400:kworker.0 00000100:00100000:0.0:1788833189.490971:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265907328:0@lo:400:kworker.0 00000100:00080000:1.0:1788833189.491984:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788833189.491992:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833189.491996:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788833189.873990:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833189.997253:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788833189.997275:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265907456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833189.997360:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833189.998176:0:12183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907456 00000100:00100000:3.0:1788833189.998185:0:12183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907456 00000100:00100000:3.0:1788833189.998243:0:12183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788833189.998253:0:12183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265907456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833189.998296:0:12183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833189.998353:0:12183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265907456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833189.998360:0:12183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788833189.999734:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265907456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833190.001740:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833190.001763:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265907584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833190.001827:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833190.002637:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907584 00000100:00100000:1.0:1788833190.002647:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907584 00000100:00100000:1.0:1788833190.002687:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788833190.002696:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265907584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833190.002727:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833190.002780:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265907584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833190.002799:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788833190.003416:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265907584:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788833190.125590:0:11651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788833190.125601:0:11651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788833190.126657:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788833190.126672:0:11651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788833190.893354:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833190.907171:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833190.907276:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256489472 00000100:00100000:1.0:1788833190.907287:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256489472 00000100:00100000:1.0:1788833190.907367:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 66 00000100:00100000:1.0:1788833190.907378:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+18:12320:x1875727256489472:12345-192.168.206.55@tcp:35:umount.0 00000100:00100000:1.0:1788833190.907743:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:12320:x1875727256489472:12345-192.168.206.55@tcp:35:umount.0 Request processed in 365us (799us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788833190.907752:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 66 00000100:00080000:2.0:1788833190.909179:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833190.911699:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833190.911796:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256489728 00000100:00100000:1.0:1788833190.911806:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256489728 00000100:00100000:1.0:1788833190.911864:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 67 00000100:00100000:1.0:1788833190.911876:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+19:12320:x1875727256489728:12345-192.168.206.55@tcp:35:umount.0 00000100:00100000:1.0:1788833190.913352:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458534c2-c478-4b32-bcda-93b4ecf625e9+20:12320:x1875727256489728:12345-192.168.206.55@tcp:35:umount.0 Request processed in 1471us (1655us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788833190.913363:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 67 00000100:00100000:0.0:1788833190.918164:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833190.918321:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256489984 00000100:00100000:3.0:1788833190.918332:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256489984 00000100:00100000:3.0:1788833190.918397:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:3.0:1788833190.918407:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2af0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+20:12320:x1875727256489984:12345-192.168.206.55@tcp:35:umount.0 00000100:00100000:3.0:1788833190.918662:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2af0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+21:12320:x1875727256489984:12345-192.168.206.55@tcp:35:umount.0 Request processed in 255us (507us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788833190.918671:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:2.0:1788833190.930584:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833190.931092:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256490240 00000100:00100000:3.0:1788833190.931112:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256490240 00000100:00100000:3.0:1788833190.931193:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:3.0:1788833190.931224:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+21:12320:x1875727256490240:12345-192.168.206.55@tcp:35:umount.0 00000100:00100000:3.0:1788833190.931715:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+22:12320:x1875727256490240:12345-192.168.206.55@tcp:35:umount.0 Request processed in 509us (1136us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788833190.931726:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:0.0:1788833190.944135:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833190.944178:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833190.944208:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833190.944245:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833190.944304:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256490368 00000100:00100000:0.0:1788833190.944317:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256490368 00000100:00100000:2.0:1788833190.944341:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256490624 00000100:00100000:2.0:1788833190.944357:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256490624 00000100:00100000:0.0:1788833190.944393:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256490496 00000100:00100000:0.0:1788833190.944399:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256490496 00000100:00100000:2.0:1788833190.944443:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:2.0:1788833190.944456:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39216680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+15:2360:x1875727256490368:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833190.944474:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833190.944496:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517600/0x8c08e876ed3fea0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad96 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833190.944517:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833190.944586:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39216680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+14:2360:x1875727256490368:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 132us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833190.947688:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:0.0:1788833190.948293:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+14:2360:x1875727256490624:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833190.948326:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833190.948428:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477e00/0x8c08e876ed3febf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae61 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833190.948463:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833190.948542:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+13:2360:x1875727256490624:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 836us (4362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833190.948555:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:0.0:1788833190.948600:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:0.0:1788833190.948608:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+12:2360:x1875727256490496:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833190.948619:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833190.948631:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516a00/0x8c08e876ed3fe970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad5e expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833190.948641:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833190.948658:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea39214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+11:2360:x1875727256490496:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 52us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833190.948664:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:2.0:1788833190.949582:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:3.0:1788833190.949626:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256490752 00000100:00100000:3.0:1788833190.949643:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256490752 00000100:00100000:3.0:1788833190.949781:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 72 00000100:00100000:3.0:1788833190.949792:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2356:x1875727256490752:12345-192.168.206.55@tcp:9:umount.0 00000020:00000080:3.0:1788833190.949827:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fece2 00000100:00080000:3.0:1788833190.949838:0:6656:0:(import.c:65:import_set_state_nolock()) ffff9cea4096f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788833190.949887:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788833190.950680:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788833190.951482:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833190.955592:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458534c2-c478-4b32-bcda-93b4ecf625e9+2:2356:x1875727256490752:12345-192.168.206.55@tcp:9:umount.0 Request processed in 5782us (11325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833190.955611:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 72 00000100:00100000:3.0:1788833190.960920:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833190.961197:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256491136 00000100:00100000:1.0:1788833190.961211:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256491136 00000100:00100000:1.0:1788833190.961311:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 73 00000100:00100000:1.0:1788833190.961325:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2356:x1875727256491136:12345-192.168.206.55@tcp:9:umount.0 00000020:00000080:1.0:1788833190.961373:0:6654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fef4a 00000020:00010000:1.0:1788833190.961391:0:6654:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cea3f63b800: total 0 00000100:00080000:1.0:1788833190.961396:0:6654:0:(import.c:65:import_set_state_nolock()) ffff9cea3f639800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788833190.961455:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788833190.961787:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458534c2-c478-4b32-bcda-93b4ecf625e9+5:2356:x1875727256491136:12345-192.168.206.55@tcp:9:umount.0 Request processed in 465us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833190.961815:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 73 00000100:00080000:2.0:1788833190.962022:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1788833190.964704:0:5800:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cea3f63b800: total 0 00010000:00010000:3.0:1788833190.964783:0:5800:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cea3f63b800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788833190.964866:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca8b563/0x8c08e876ed3ff2e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b036 expref: 4 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833190.964937:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a43662/0x8c08e876ed3ff984 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b204 expref: 3 pid: 6654 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833190.964955:0:5800:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cea3f63b800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788833190.964967:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833190.964969:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833190.964971:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833190.975303:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833190.975555:0:8616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256492160 00000100:00100000:0.0:1788833190.975568:0:8616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256492160 00000100:00100000:0.0:1788833190.975649:0:8616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 240 00000100:00100000:0.0:1788833190.975662:0:8616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+22:2356:x1875727256492160:12345-192.168.206.55@tcp:39:umount.0 00000020:00000080:0.0:1788833190.975743:0:8616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe97e 00000020:00010000:0.0:1788833190.975766:0:8616:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ce901274800: total 0 00000100:00080000:0.0:1788833190.975772:0:8616:0:(import.c:65:import_set_state_nolock()) ffff9cea068ec000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788833190.975809:0:8616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788833190.976351:0:8472:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ce901274800: total 0 00010000:00010000:1.0:1788833190.976421:0:8472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ce901274800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788833190.976476:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:1.0:1788833190.976481:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833190.976493:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dce00/0x8c08e876ed3ff348 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b052 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.976515:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea0884ed00) 00010000:00010000:1.0:1788833190.976518:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833190.976523:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f200/0x8c08e876ed3fec64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae76 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.976543:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833190.976546:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833190.976550:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fe00/0x8c08e876ed3ff2a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b021 expref: 19 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.979847:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833190.979855:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833190.979931:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a200/0x8c08e876ed3ff945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1ef expref: 18 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.979960:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833190.979963:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788833190.979967:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037600/0x8c08e876ed3ff96f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1fd expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.980002:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:1.0:1788833190.980005:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833190.980009:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dd000/0x8c08e876ed3fefa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72af5d expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.980023:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cea08db1000) 00010000:00010000:1.0:1788833190.980025:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833190.980045:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea32477600/0x8c08e876ed3fec48 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae6f expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.980065:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833190.980067:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788833190.980071:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ff2d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b02f expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.980081:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833190.980083:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788833190.980087:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ff643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b12b expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.980097:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cea0884ea00) 00010000:00010000:1.0:1788833190.980099:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788833190.980102:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fecb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae8b expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.980115:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cea32de4300) 00010000:00010000:1.0:1788833190.980117:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833190.980128:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea421dc600/0x8c08e876ed3ff865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b1b7 expref: 11 pid: 8616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.981064:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cea08db1f00) 00010000:00010000:1.0:1788833190.981070:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788833190.981077:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ac00/0x8c08e876ed3ff364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b059 expref: 10 pid: 11926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.981095:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cea32de4100) 00010000:00010000:1.0:1788833190.981097:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833190.981101:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea1f037c00/0x8c08e876ed3ff1c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72afe9 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833190.981114:0:8472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ce901274800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788833190.981217:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833190.981220:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833190.981223:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833190.986630:0:8616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458534c2-c478-4b32-bcda-93b4ecf625e9+7:2356:x1875727256492160:12345-192.168.206.55@tcp:39:umount.0 Request processed in 10954us (11334us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788833190.986649:0:8616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 240 00010000:00010000:2.0:1788833191.920550:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788833192.628006:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:0.0:1788833192.628019:0:7611:0:(genops.c:885:class_export_put()) final put ffff9cea4096c000/458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:3.0:1788833192.628328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea4096c000/458534c2-c478-4b32-bcda-93b4ecf625e9 for lustre-OST0001 00000020:00000080:3.0:1788833192.628400:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea4096f000 for lustre-OST0001 00010000:00010000:3.0:1788833192.943874:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833193.220026:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833193.220086:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833193.220508:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256492288 00000100:00100000:3.0:1788833193.220518:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256492288 00000100:00100000:3.0:1788833193.220585:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1788833193.220595:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2358:x1875727256492288:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833193.220609:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833193.220630:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3fea50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72adab expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833193.220645:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833193.220700:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:2358:x1875727256492288:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 107us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833193.220708:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:2.0:1788833193.221469:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833193.221559:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256492544 00000100:00100000:0.0:1788833193.221565:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256492544 00000100:00100000:0.0:1788833193.221608:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256492416 00000100:00100000:0.0:1788833193.221611:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256492416 00000100:00100000:0.0:1788833193.221640:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:0.0:1788833193.221649:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+10:2358:x1875727256492544:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833193.221659:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833193.221673:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea1f036200/0x8c08e876ed3febed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ae5a expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833193.221684:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833193.221719:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+9:2358:x1875727256492544:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 71us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833193.221725:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:0.0:1788833193.221777:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:0.0:1788833193.221783:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+8:2358:x1875727256492416:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833193.221789:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833193.221798:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477000/0x8c08e876ed3fea57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72add5 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833193.221806:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833193.221832:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+7:2358:x1875727256492416:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 49us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833193.221838:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:0.0:1788833193.225527:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833193.225616:0:11926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256492800 00000100:00100000:2.0:1788833193.225625:0:11926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256492800 00000100:00100000:2.0:1788833193.225699:0:11926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 241 00000100:00100000:2.0:1788833193.225709:0:11926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95db0428-be24-4f30-b1d9-80f4991cba8f+6:2356:x1875727256492800:12345-192.168.206.55@tcp:39:umount.0 00000020:00000080:2.0:1788833193.225747:0:11926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fea65 00000020:00010000:2.0:1788833193.225755:0:11926:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cea1f41c800: total 0 00000100:00080000:2.0:1788833193.225759:0:11926:0:(import.c:65:import_set_state_nolock()) ffff9cea1f41d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788833193.225790:0:11926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788833193.225919:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788833193.226073:0:8472:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cea1f41c800: total 0 00010000:00010000:0.0:1788833193.226078:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833193.226128:0:8472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cea1f41c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788833193.226161:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4200) 00010000:00010000:0.0:1788833193.226164:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833193.226172:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea02facc00/0x8c08e876ed3ff992 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b20b expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833193.226203:0:8472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cea1f41c800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788833193.226213:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833193.226215:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833193.226216:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833193.226687:0:11926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95db0428-be24-4f30-b1d9-80f4991cba8f+3:2356:x1875727256492800:12345-192.168.206.55@tcp:39:umount.0 Request processed in 978us (1168us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788833193.226696:0:11926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 241 00000100:00100000:0.0:1788833193.247395:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833193.249805:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493056 00000100:00100000:3.0:1788833193.249830:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493056 00000100:00100000:3.0:1788833193.249927:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 300 00000100:00100000:3.0:1788833193.249957:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+7:2356:x1875727256493056:12345-192.168.206.55@tcp:251:umount.0 00000020:00000080:3.0:1788833193.250018:0:5807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe95b 00000020:00010000:3.0:1788833193.250028:0:5807:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ce901272800: total 0 00000100:00080000:3.0:1788833193.250061:0:5807:0:(import.c:65:import_set_state_nolock()) ffff9ce901271000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788833193.250174:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e4041fb-b72d-4a84-89ff-1db735bdf82e+3:2356:x1875727256493056:12345-192.168.206.55@tcp:251:umount.0 Request processed in 220us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833193.250184:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 300 00000020:00010000:2.0:1788833193.250385:0:5801:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ce901272800: total 0 00010000:00010000:2.0:1788833193.250470:0:5801:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ce901272800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788833193.250513:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932f400/0x8c08e876ed3fea11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72ad9d expref: 2 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833193.250534:0:5801:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ce901272800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788833193.250545:0:5801:0:(genops.c:885:class_export_put()) final put ffff9ce901272800/8e4041fb-b72d-4a84-89ff-1db735bdf82e 00010000:00010000:2.0:1788833193.250561:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833193.250563:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833193.250565:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788833193.250739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce901272800/8e4041fb-b72d-4a84-89ff-1db735bdf82e for MGS 00000020:00000080:3.0:1788833193.250787:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ce901271000 for MGS 00010000:00010000:3.0:1788833193.965248:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833194.605313:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265907968:0@lo:400:kworker.0 00000100:00100000:2.0:1788833194.605381:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833194.605446:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833194.605452:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265908096:0@lo:400:kworker.0 00000100:00100000:2.0:1788833194.605475:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833194.605508:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907968 00000100:00100000:2.0:1788833194.605514:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907968 00000100:00100000:2.0:1788833194.605565:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788833194.605573:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265907968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833194.605614:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265907968:12345-0@lo:400:kworker.0 Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833194.605620:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788833194.605640:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908096 00000100:00100000:2.0:1788833194.605643:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908096 00000100:00100000:2.0:1788833194.605664:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788833194.605669:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265908096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833194.605692:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265908096:12345-0@lo:400:kworker.0 Request processed in 24us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833194.605698:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788833194.605711:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833194.605715:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833194.605745:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265908096:0@lo:400:kworker.0 00000100:00100000:2.0:1788833194.605754:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265907968:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.605896:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265907840:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.605927:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833194.605954:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265908352:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.605973:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833194.605993:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788833194.605999:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265907712:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606024:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833194.606064:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265908224:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833194.606112:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907840 00000100:00100000:3.0:1788833194.606116:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907840 00000100:00100000:3.0:1788833194.606139:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908224 00000100:00100000:3.0:1788833194.606142:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908224 00000100:00100000:3.0:1788833194.606167:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788833194.606174:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265907840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606211:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265907840:12345-0@lo:400:kworker.0 Request processed in 37us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833194.606226:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788833194.606241:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788833194.606247:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265908224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606276:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875727265908224:12345-0@lo:400:kworker.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833194.606283:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788833194.606300:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908352 00000100:00100000:3.0:1788833194.606304:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908352 00000100:00100000:3.0:1788833194.606329:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788833194.606335:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265908352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606379:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265908352:12345-0@lo:400:kworker.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833194.606385:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788833194.606402:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265907712 00000100:00100000:3.0:1788833194.606406:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265907712 00000100:00100000:3.0:1788833194.606442:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788833194.606449:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265907712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606479:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265907712:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833194.606485:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1788833194.606519:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833194.606523:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833194.606541:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265907712:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606551:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265908224:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606561:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265907840:0@lo:400:kworker.0 00000100:00100000:3.0:1788833194.606580:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265908352:0@lo:400:kworker.0 00010000:00010000:2.0:1788833194.989494:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833195.118620:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265908480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833195.118694:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833195.119062:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265908608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833195.119102:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833195.119523:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908480 00000100:00100000:1.0:1788833195.119531:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908480 00000100:00100000:1.0:1788833195.119575:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908608 00000100:00100000:1.0:1788833195.119578:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908608 00000100:00100000:1.0:1788833195.119592:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788833195.119600:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265908480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833195.119629:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833195.119673:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265908480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833195.119680:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788833195.119693:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788833195.119719:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265908608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833195.119735:0:6657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833195.126858:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265908608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7142us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833195.126871:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788833195.126959:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265908480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833195.131934:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265908608:0@lo:13:osp-pre-0-0.0 00000020:01000004:3.0:1788833195.148172:0:12982:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000001:00080000:1.0:1788833195.190059:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:1.0:1788833195.190083:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95db0428-be24-4f30-b1d9-80f4991cba8f 00000001:00080000:1.0:1788833195.190090:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788833195.190094:0:5835:0:(genops.c:885:class_export_put()) final put ffff9cea1f41c800/95db0428-be24-4f30-b1d9-80f4991cba8f 00000001:00100000:1.0:1788833195.190106:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:1.0:1788833195.190113:0:5835:0:(genops.c:885:class_export_put()) final put ffff9ce901274800/458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:1.0:1788833195.190124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1f41c800/95db0428-be24-4f30-b1d9-80f4991cba8f for lustre-MDT0000 00000020:00000080:1.0:1788833195.190183:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce901274800/458534c2-c478-4b32-bcda-93b4ecf625e9 for lustre-MDT0000 00000020:00000080:1.0:1788833195.190212:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea1f41d800 for lustre-MDT0000 00000020:00000080:1.0:1788833195.190217:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea068ec000 for lustre-MDT0000 00000020:01000004:3.0:1788833195.194099:0:12982:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788833195.194283:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.194298:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.194306:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.194314:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.194332:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788833195.194337:0:12982:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788833195.194369:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788833195.194374:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788833195.194380:0:12982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788833195.194405:0:12982:0:(import.c:65:import_set_state_nolock()) ffff9cea40906000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788833195.195118:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833195.195128:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.195137:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc400 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:3.0:1788833195.195141:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.195161:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788833195.195168:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833195.195174:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788833195.195177:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788833195.195181:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788833195.195210:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.195218:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788833195.195245:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.195253:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea421dc400/0x8c08e876ed3fe9e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.195265:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833195.195267:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833195.195269:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833195.195276:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788833195.195293:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265908864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788833195.195350:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833195.195741:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265908736:0@lo:39:umount.0 00000100:00100000:2.0:1788833195.195779:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833195.195813:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908864 00000100:00100000:2.0:1788833195.195821:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908736 00000100:00100000:1.0:1788833195.195822:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908864 00000100:00100000:2.0:1788833195.195827:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908736 00000100:00100000:2.0:1788833195.195885:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788833195.195885:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788833195.195896:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265908864:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833195.195905:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875727265908736:12345-0@lo:39:umount.0 00010000:00010000:1.0:1788833195.195912:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1788833195.195932:0:5813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe76a 00010000:00010000:1.0:1788833195.195936:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3fe9e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe9e0 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788833195.195943:0:5813:0:(import.c:65:import_set_state_nolock()) ffff9cea40905000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788833195.195950:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833195.195990:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:3279:x1875727265908864:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833195.196006:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788833195.196215:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3275:x1875727265908736:12345-0@lo:39:umount.0 Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833195.196224:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788833195.196234:0:5813:0:(genops.c:885:class_export_put()) final put ffff9cea40902800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788833195.196277:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833195.196294:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265908864:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788833195.196300:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea40906000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788833195.196314:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265908736:0@lo:39:umount.0 00000020:00000080:1.0:1788833195.196347:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea40902800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788833195.196406:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea40905000 for lustre-MDT0000 00000100:00080000:2.0:1788833195.196472:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788833195.196476:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788833195.196481:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788833195.197898:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.197926:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.197934:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.197940:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.197963:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833195.197969:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.197976:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.197982:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.197987:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198006:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788833195.198011:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198016:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198061:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198067:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198076:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788833195.198081:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198089:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198095:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198100:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833195.198106:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788833195.198109:0:12982:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788833195.198132:0:12982:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788833195.198135:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788833195.198139:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.198158:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788833195.198165:0:12982:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cea06624800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788833195.198170:0:12982:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cea3f68a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788833195.198175:0:12982:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9cea1f788000) has exports, disconnecting them 00000020:00080000:3.0:1788833195.198184:0:12982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cea06624800), last request at 1788833194 00000020:00000080:3.0:1788833195.198192:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe8dd 00010000:00010000:2.0:1788833195.198201:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788833195.198210:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788833195.198211:0:12982:0:(import.c:65:import_set_state_nolock()) ffff9cea06623800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788833195.198222:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932e400 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833195.198227:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198237:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833195.198245:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788833195.198251:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cea06624800): rc 0 10000000:01000000:2.0:1788833195.198252:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:3.0:1788833195.198256:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea06624800/lustre-MDT0000-lwp-OST0001_UUID 10000000:01000000:2.0:1788833195.198266:0:8472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00080000:3.0:1788833195.198268:0:12982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cea3f68a800), last request at 1788833194 00000020:00000080:3.0:1788833195.198272:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe812 10000000:01000000:2.0:1788833195.198278:0:8472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:3.0:1788833195.198279:0:12982:0:(import.c:65:import_set_state_nolock()) ffff9cea3b3ba800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788833195.198291:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea06624800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1788833195.198314:0:8472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198323:0:8472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1788833195.198330:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea06623800 for lustre-MDT0000 00000020:00080000:3.0:1788833195.198348:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cea3f68a800): rc 0 00000020:00000080:3.0:1788833195.198350:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea3f68a800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1788833195.198465:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198473:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea3932e400/0x8c08e876ed3fe9ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9f5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198596:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788833195.198602:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198608:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476c00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833195.198611:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198618:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833195.198624:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833195.198629:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788833195.198631:0:8472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788833195.198632:0:8472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788833195.198648:0:8472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198653:0:8472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833195.198675:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198682:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476c00/0x8c08e876ed3fe915 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe91c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198694:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833195.198697:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198703:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932e600 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833195.198706:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198712:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833195.198718:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833195.198723:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788833195.198725:0:8472:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788833195.198726:0:8472:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788833195.198736:0:8472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198740:0:8472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833195.198745:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198750:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3fec17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fec1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198765:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833195.198768:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198773:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516200 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833195.198775:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198781:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833195.198787:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833195.198792:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788833195.198794:0:8472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788833195.198796:0:8472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788833195.198808:0:8472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198813:0:8472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833195.198818:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.198823:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01516200/0x8c08e876ed3fe6c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe6d0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:3.0:1788833195.198830:0:12982:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb42c0412bae0 00010000:00010000:2.0:1788833195.198833:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833195.198835:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833195.198843:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833195.198850:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833195.198861:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265908992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788833195.198912:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833195.198918:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833195.199018:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833195.199024:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265909376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833195.199067:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833195.199091:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265909120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833195.199112:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833195.199128:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833195.199133:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265909248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833195.199152:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833195.199178:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265908992 00000100:00100000:2.0:1788833195.199184:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265908992 00000100:00100000:2.0:1788833195.199219:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265909376 00000100:00100000:2.0:1788833195.199223:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265909376 00000100:00100000:2.0:1788833195.199233:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265909120 00000100:00100000:2.0:1788833195.199235:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265909120 00000100:00100000:2.0:1788833195.199243:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265909248 00000100:00100000:2.0:1788833195.199244:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265909248 00000100:00100000:2.0:1788833195.199323:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833195.199401:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+21:3279:x1875727265908992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833195.199447:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833195.199462:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea32477800/0x8c08e876ed3fe9f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe9ee expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.199474:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833195.199577:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+20:3279:x1875727265908992:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833195.199594:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833195.199614:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788833195.199620:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+19:3279:x1875727265909376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833195.199628:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833195.199638:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea42167c00/0x8c08e876ed3fe6d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe6c9 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.199652:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833195.199675:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+18:3279:x1875727265909376:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833195.199681:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788833195.199692:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788833195.199698:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+17:3276:x1875727265909120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833195.199706:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833195.199714:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932ee00/0x8c08e876ed3fe91c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe915 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.199722:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833195.199746:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+16:3276:x1875727265909120:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833195.199751:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788833195.199763:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788833195.199769:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+15:3276:x1875727265909248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833195.199776:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833195.199784:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932e200/0x8c08e876ed3fec1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fec17 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833195.199803:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833195.199827:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e9edd7-a155-4c7b-bcad-c363b29ac1f4+14:3276:x1875727265909248:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833195.199833:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788833195.199869:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265909376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833195.199877:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3279:1875727265908992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833195.199902:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265909248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833195.199910:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3276:1875727265909120:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788833195.203514:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788833195.203522:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788833195.203540:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788833195.203598:0:12982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788833195.203622:0:12982:0:(import.c:65:import_set_state_nolock()) ffff9cea26c6b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788833195.203643:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788833195.203645:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788833195.203656:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788833195.203701:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265909504:0@lo:9:umount.0 00000100:00080000:2.0:1788833195.203737:0:12982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788833195.203749:0:12982:0:(import.c:65:import_set_state_nolock()) ffff9cea3f4b6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788833195.203785:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788833195.203787:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cea1f788000) has no exports 00000100:00100000:0.0:1788833195.203828:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265909632:0@lo:9:umount.0 00000100:00100000:0.0:1788833195.203852:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833195.203896:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265909504 00000100:00100000:0.0:1788833195.203905:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265909504 00000100:00100000:0.0:1788833195.203962:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265909632 00000100:00100000:0.0:1788833195.203967:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265909632 00000100:00100000:0.0:1788833195.203994:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788833195.204004:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875727265909504:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788833195.204027:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe85f 00000100:00100000:2.0:1788833195.204132:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788833195.204142:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875727265909632:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788833195.204156:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe946 00000100:00080000:2.0:1788833195.204164:0:6656:0:(import.c:65:import_set_state_nolock()) ffff9ce901270000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788833195.204195:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1788833195.204273:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9cea3f68a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788833195.204311:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788833195.204565:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3275:x1875727265909632:12345-0@lo:9:umount.0 Request processed in 423us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833195.204574:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1788833195.204600:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833195.204684:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833195.204830:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3275:x1875727265909504:12345-0@lo:9:umount.0 Request processed in 827us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833195.204838:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788833195.205116:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea3f4b6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788833195.205131:0:3275:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788833195.205133:0:3275:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788833195.205137:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265909632:0@lo:9:umount.0 00000100:00080000:0.0:1788833195.205149:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea26c6b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788833195.205158:0:3275:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788833195.205160:0:3275:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788833195.205163:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265909504:0@lo:9:umount.0 00000020:00000080:3.0:1788833195.205879:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f68a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788833195.206221:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3b3ba800 for lustre-MDT0000 00000020:00080000:2.0:1788833195.211680:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cea1f788000) has no exports 00000001:00100000:0.0:1788833195.232495:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:0.0:1788833195.232506:0:6679:0:(genops.c:885:class_export_put()) final put ffff9cea3f63b800/458534c2-c478-4b32-bcda-93b4ecf625e9 00000020:00000080:3.0:1788833195.232597:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f63b800/458534c2-c478-4b32-bcda-93b4ecf625e9 for lustre-OST0000 00000020:00000080:3.0:1788833195.232663:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3f639800 for lustre-OST0000 00000020:00000080:2.0:1788833195.255667:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe724 00000020:00000080:2.0:1788833195.255684:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea26f42000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788833195.255760:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788833195.255849:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.255860:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788833195.255864:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9cea1f7899b8) has no exports 00000020:00000080:3.0:1788833195.256273:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe71d 00000020:00000080:3.0:1788833195.256280:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea1fc5f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788833195.256482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea26f42000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788833195.256568:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1fc5f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788833195.256715:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833195.256723:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788833195.256727:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea1fc58800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788833195.256730:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1fc58800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788833195.256737:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1788833195.256859:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea1f2654e0 - data ffff9cea1e230798/ffff9cea1f025800 00000020:01000000:3.0:1788833195.256995:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea269b6300 - data ffff9cea33fbe948/ffff9cea0693c000 00000001:00000004:3.0:1788833195.296067:0:12982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1788833195.348054:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788833195.348064:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788833195.348091:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788833195.348094:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788833195.348581:0:7127:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788833195.348586:0:7127:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788833195.348597:0:7127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788833195.350016:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788833195.350023:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788833195.350064:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788833195.350068:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788833195.350463:0:8008:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788833195.350467:0:8008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788833195.350477:0:8008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788833195.395586:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe6ec 00000020:00000080:3.0:1788833195.395598:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea1f77a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788833195.396740:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe701 00000020:00000080:3.0:1788833195.396750:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea1f77d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788833195.396756:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788833195.396761:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.396770:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788833195.396773:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9cea10ad3370) has no exports 00000004:01000000:3.0:1788833195.396948:0:12982:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788833195.396957:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe93f 00000020:00000080:3.0:1788833195.396961:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea3f6f1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788833195.396965:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788833195.396968:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.396974:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788833195.396976:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9cea068a4d28) has no exports 00000020:00000080:3.0:1788833195.396981:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe938 00000020:00000080:3.0:1788833195.396985:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea3f4b4000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788833195.397333:0:12982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788833195.397338:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788833195.397341:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788833195.397346:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788833195.397349:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788833195.397379:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833195.397386:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788833195.397391:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe858 00000020:00000080:3.0:1788833195.397404:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea3b3e3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788833195.397408:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788833195.397422:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.397427:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788833195.397430:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9cea3f7119b8) has no exports 00000020:00000080:3.0:1788833195.397434:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe851 00000020:00000080:3.0:1788833195.397436:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea26c68800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788833195.397741:0:12982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788833195.397744:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788833195.397747:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788833195.397750:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788833195.397752:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788833195.397776:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833195.397780:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788833195.397810:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833195.397813:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788833195.397837:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe708 00000020:00000080:3.0:1788833195.397842:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea1f778000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788833195.397845:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788833195.397849:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.397852:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788833195.397854:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9cea1f78cd28) has no exports 00000020:00000080:3.0:1788833195.397877:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833195.397882:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788833195.397884:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe70f 00000020:00000080:3.0:1788833195.397887:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea1f77b000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788833195.397895:0:12982:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea100dd800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788833195.397897:0:12982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea100dd800 3 00000020:01000004:3.0:1788833195.397900:0:12982:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cea100dd800 from lustre-MDT0000 00000020:00000080:3.0:1788833195.397915:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833195.397917:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788833195.397920:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea1f779000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788833195.397923:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1f779000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788833195.397937:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788833195.398000:0:12982:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788833195.398004:0:12982:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788833195.398007:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788833195.398009:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.398012:0:12982:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788833195.398018:0:12982:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9cea10211800 50e9edd7-a155-4c7b-bcad-c363b29ac1f4 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788833195.398023:0:12982:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9cea06994d28) has exports, disconnecting them 00000020:00080000:3.0:1788833195.398027:0:12982:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cea10211800), last request at 1788832978 00000020:00000080:3.0:1788833195.398073:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe6ad 00000020:00010000:3.0:1788833195.398077:0:12982:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cea10211800: total 8 00000100:00080000:3.0:1788833195.398082:0:12982:0:(import.c:65:import_set_state_nolock()) ffff9cea10211000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788833195.398095:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cea10211800): rc 0 00000020:00080000:3.0:1788833195.398099:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9cea06994d28) has no exports 00000100:00100000:3.0:1788833195.398275:0:5804:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cea10183c00:5804] 0 exiting: rc = 1 00000020:00000080:2.0:1788833195.398451:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1f77a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788833195.398465:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1f77d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788833195.398469:0:8:0:(genops.c:885:class_export_put()) final put ffff9cea37d42800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788833195.398471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea37d42800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788833195.398474:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788833195.398602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f6f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788833195.398607:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f4b4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788833195.398612:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3f4b6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788833195.398616:0:8:0:(genops.c:885:class_export_put()) final put ffff9cea3f4b3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788833195.398618:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f4b3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788833195.398621:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788833195.398649:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3b3e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788833195.398655:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea26c68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788833195.398670:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea26c6b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788833195.398677:0:8:0:(genops.c:885:class_export_put()) final put ffff9cea26c6f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788833195.398679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea26c6f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788833195.398684:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788833195.398748:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1f778000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788833195.398752:0:8:0:(genops.c:885:class_export_put()) final put ffff9cea1f77d000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788833195.398753:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1f77d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788833195.398757:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788833195.398884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea1f77b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788833195.398960:0:5801:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cea10211800: total 0 00010000:00010000:1.0:1788833195.398991:0:5801:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cea10211800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788833195.399025:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea1f037e00/0x8c08e876ed3fec02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3febfb expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399069:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932f000/0x8c08e876ed3fec10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fec09 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399082:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dd800/0x8c08e876ed3fe7c5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe7be expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399096:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516600/0x8c08e876ed3fea03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe9fc expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399107:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932ec00/0x8c08e876ed3fe9af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe9a8 expref: 5 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399117:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea421dc000/0x8c08e876ed3fe9bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe9b6 expref: 4 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399128:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3fe9cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe9c4 expref: 3 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399137:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517800/0x8c08e876ed3fe9d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c08e876ed3fe9d2 expref: 2 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833195.399158:0:5801:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cea10211800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788833195.399170:0:5801:0:(genops.c:885:class_export_put()) final put ffff9cea10211800/50e9edd7-a155-4c7b-bcad-c363b29ac1f4 00010000:00010000:1.0:1788833195.399186:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833195.399188:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833195.399190:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788833195.399242:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea10211800/50e9edd7-a155-4c7b-bcad-c363b29ac1f4 for MGS 00000020:00000080:2.0:1788833195.399287:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea10211000 for MGS 00000100:00100000:0.0:1788833195.399481:0:5806:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cea06822600:5806] 1 exiting: rc = 0 00000100:00100000:3.0:1788833195.399880:0:5807:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cea06823400:5807] 2 exiting: rc = 0 00000100:00100000:2.0:1788833195.399973:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.399981:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.399988:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.399994:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.399999:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400005:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400011:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400017:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400022:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400059:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400066:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400072:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400078:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400083:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400089:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400094:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400100:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400105:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400110:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400116:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400121:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400136:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400142:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400147:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400153:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400158:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400165:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400170:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400176:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400182:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400187:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400193:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400198:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400203:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400208:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400213:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400219:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400224:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400230:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400235:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400241:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400247:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400252:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400273:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400278:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400285:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400290:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400296:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400301:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400306:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400311:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400316:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400321:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400327:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400332:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400337:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400351:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400356:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400362:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400367:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400373:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400378:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400384:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.400389:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788833195.400772:0:12982:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788833195.400776:0:12982:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788833195.401962:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea06715900 - data ffff9cea33fa1e58/ffff9cea3f573c00 00000020:01000000:2.0:1788833195.402288:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea20283ea0 - data ffff9cea33f86510/ffff9cea42051c00 00000020:00000080:2.0:1788833195.402778:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe691 00000020:00000080:2.0:1788833195.402786:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea100da000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788833195.402802:0:12982:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea100dd800 from MGS, refs=2 00000020:01000004:2.0:1788833195.402805:0:12982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea100dd800 2 00000020:01000004:2.0:1788833195.402808:0:12982:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cea100dd800 from MGS 00000020:00000080:2.0:1788833195.402830:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788833195.402837:0:12982:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788833195.402839:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea100dc000/MGS 00000020:00000080:2.0:1788833195.402842:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea100dc000/MGS for MGS 00000020:01000000:2.0:1788833195.402848:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788833195.402899:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788833195.402902:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788833195.402907:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788833195.402913:0:12982:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cea40904000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788833195.402918:0:12982:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9cea068a3370) has exports, disconnecting them 00000020:00080000:2.0:1788833195.402922:0:12982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cea40904000), last request at 1788832979 00000020:00000080:2.0:1788833195.402926:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe75c 00000020:00080000:2.0:1788833195.402935:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cea40904000): rc 0 00000020:00000080:2.0:1788833195.402940:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea40904000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788833195.403668:0:12982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788833195.403674:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788833195.403678:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788833195.403685:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788833195.403831:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833195.403836:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788833195.403841:0:12982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea100dd800 1 00000020:00000080:3.0:1788833195.403845:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe683 00000020:00000080:3.0:1788833195.403849:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea100d8800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788833195.403853:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788833195.403857:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833195.403859:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788833195.403862:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9cea10ad0000) has no exports 00000020:00000080:1.0:1788833195.404079:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea100da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788833195.404095:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea40904000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788833195.404101:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea40906000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788833195.404106:0:471:0:(genops.c:885:class_export_put()) final put ffff9cea40900000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788833195.404108:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea40900000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788833195.404113:0:471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788833195.404159:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea100d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788833195.432562:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788833195.432575:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788833195.432580:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea113b6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788833195.432585:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea113b6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788833195.432593:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788833195.432704:0:12982:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cea100de800 00000020:01000000:1.0:1788833195.432725:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788833195.432729:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788833195.432733:0:12982:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788833195.432737:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9cea10ad19b8) has no exports 00000100:00100000:3.0:1788833195.432830:0:5812:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9cea10045000:5812] 1 exiting: rc = 0 00000100:00100000:3.0:1788833195.432907:0:5811:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9cea03506400:5811] 0 exiting: rc = 1 00000100:00100000:1.0:1788833195.437137:0:8616:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cea40913400:8616] 3 exiting: rc = 0 00000100:00100000:2.0:1788833195.441446:0:5813:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9cea10045800:5813] 2 exiting: rc = 0 00000100:00100000:2.0:1788833195.441633:0:11926:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9cea04f77600:11926] 4 exiting: rc = 0 00000100:00100000:1.0:1788833195.441849:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441863:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441871:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441876:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441881:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441894:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441899:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441904:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441909:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441915:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441919:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441925:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441934:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441941:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441946:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441952:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441957:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441963:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441968:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441974:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441979:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441984:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441989:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.441994:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442000:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442004:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442009:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442014:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442019:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442024:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442048:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442054:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442060:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442065:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442071:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442076:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442080:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442085:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442091:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442097:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442109:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442114:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442119:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442123:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442128:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442133:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442138:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442142:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442147:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442152:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442157:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442161:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442166:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442171:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442176:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442181:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442187:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442192:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442196:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442202:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442206:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442211:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442222:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.442228:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833195.446805:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cea10044200:5814] 0 exiting: rc = 1 00000100:00100000:2.0:1788833195.446849:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9cea10044c00:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1788833195.446931:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.446940:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.446945:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.446977:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.446983:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.446988:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.446993:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.446998:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447004:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447009:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447013:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447078:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447087:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447092:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447097:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447101:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447106:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447110:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447114:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447119:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447123:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447127:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447131:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447136:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447140:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447145:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447149:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447153:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447157:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447162:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447166:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447170:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447180:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447188:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447193:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447198:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447203:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447208:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447237:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447243:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447247:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447252:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447256:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447262:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447266:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447271:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447285:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447289:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447295:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447300:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447305:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447311:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447316:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447321:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447395:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447401:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447405:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447421:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447427:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447432:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447437:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447441:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447446:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.447450:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833195.448250:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9cea06755800:5816] 0 exiting: rc = 1 00000100:00100000:2.0:1788833195.448250:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9cea066d4800:5818] 1 exiting: rc = 0 00000100:00100000:1.0:1788833195.448443:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448452:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448459:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448466:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448472:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448478:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448564:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448572:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448578:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448588:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448594:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448603:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448610:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448617:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448622:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448628:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448634:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448647:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448668:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448675:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448680:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448685:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448691:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448697:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448702:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448708:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448714:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448719:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448724:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448730:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448747:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448753:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448760:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448766:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448772:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448777:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448783:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448788:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448799:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448806:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448812:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448818:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448840:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448847:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448853:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448859:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448865:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448871:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448876:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448881:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448887:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448893:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448904:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448911:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448928:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448934:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448939:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448944:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448950:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448955:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448961:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448966:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448971:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.448981:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833195.463773:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9cea2afd9400:5820] 1 exiting: rc = 0 00000100:00100000:1.0:1788833195.464085:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9cea06754200:5819] 0 exiting: rc = 1 00000100:00100000:2.0:1788833195.464991:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.464998:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465004:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465009:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465014:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465019:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465026:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465064:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465069:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465074:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465080:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465085:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465090:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465095:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465100:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465105:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465111:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465117:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465122:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465127:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465132:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465136:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465141:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465147:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465152:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465157:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465162:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465167:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465172:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465177:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465182:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465199:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465203:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465208:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465213:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465218:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465223:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465228:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465233:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465238:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465243:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465248:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465363:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465373:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465378:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465384:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465390:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465395:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465401:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465406:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465421:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465427:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465432:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465437:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465442:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465446:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465452:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465457:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465462:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465467:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465472:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465477:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465481:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.465487:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833195.466530:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cea37c4b400:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1788833195.466672:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cea37c4b600:5822] 1 exiting: rc = 0 00000100:00100000:2.0:1788833195.466724:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466739:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466744:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466749:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466755:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466759:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466764:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466769:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466774:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466779:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466784:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466789:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466794:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466799:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466804:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466809:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466814:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466819:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466824:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466829:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466834:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466839:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466844:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466848:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466853:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466858:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466864:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466870:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466874:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466879:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466883:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466889:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466893:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466898:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466903:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466908:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466920:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466925:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466930:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466935:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466940:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466957:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466963:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466967:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466972:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466977:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466982:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466987:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466991:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.466996:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.467000:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.467005:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.467010:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.467015:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.467020:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.467025:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468822:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468831:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468837:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468842:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468847:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468852:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468857:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.468862:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.469857:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cea37c4a800:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1788833195.470068:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cea37c4b800:5823] 0 exiting: rc = 1 00000100:00100000:2.0:1788833195.470216:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470223:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470228:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470233:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470237:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470242:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470246:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470275:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470280:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470284:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470289:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470294:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470299:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470305:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470309:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470313:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470318:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470323:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470328:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470333:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470337:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470342:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470347:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470352:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470356:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470360:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470364:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470368:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470373:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470377:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470382:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470386:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470390:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470395:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470399:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470404:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470409:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470424:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470429:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470434:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470438:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470443:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470455:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470459:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470464:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470469:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470474:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470478:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470482:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470487:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470492:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470498:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470502:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470507:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470512:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470517:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470522:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470526:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470531:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470536:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470541:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470546:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470551:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.470556:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833195.471246:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9cea37c49800:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788833195.471499:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9cea37c4bc00:5827] 2 exiting: rc = 0 00000100:00100000:3.0:1788833195.471784:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9cea37d2ae00:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1788833195.471883:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471889:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471894:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471899:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471905:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471910:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471915:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471920:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471925:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471931:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471941:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.471988:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472001:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472005:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472011:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472015:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472020:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472025:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472126:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472133:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472149:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472156:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472161:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472166:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472171:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472175:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472180:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472186:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472191:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472196:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472201:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472206:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472211:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472216:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472220:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472226:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472231:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472237:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472345:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472353:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472358:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472364:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472369:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472375:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472395:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472401:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472406:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472427:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472432:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472437:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472442:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472447:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472452:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472457:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472462:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472467:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472473:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472479:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472484:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472489:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472495:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472500:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472506:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788833195.472511:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788833195.476883:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788833195.476895:0:12982:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788833195.476901:0:12982:0:(genops.c:885:class_export_put()) final put ffff9cea05deb000/MDS_uuid 00000020:00000080:2.0:1788833195.476905:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea05deb000/MDS_uuid for MDS 00000020:01000000:2.0:1788833195.476910:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788833195.477177:0:12982:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788833196.014137:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833197.049516:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788833197.737152:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788833197.737161:0:7611:0:(genops.c:885:class_export_put()) final put ffff9ce901273000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788833197.737190:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce901273000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788833197.737228:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ce901270000 for lustre-OST0001 00010000:00010000:1.0:1788833198.061465:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788833198.512386:0:13135:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788833198.524463:0:13135:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788833198.524689:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833198.524706:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833198.524714:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833198.524722:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833198.524746:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788833198.524759:0:13135:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788833198.524785:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788833198.524790:0:13135:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788833198.524804:0:13135:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788833198.524835:0:13135:0:(import.c:65:import_set_state_nolock()) ffff9cea3f68f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788833198.524939:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833198.524948:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833198.524957:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea421dc800 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833198.524974:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833198.524993:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833198.525001:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833198.525008:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788833198.525017:0:8472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788833198.525019:0:8472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1788833198.525811:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875727265909760:0@lo:39:umount.0 00000400:00000100:1.0:1788833198.525968:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875727265909760 offset 0 length 224: 4 00010000:00010000:2.0:1788833198.527803:0:8472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833198.527822:0:8472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833198.527858:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833198.527868:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea421dc800/0x8c08e876ed3fe9c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c08e876ed3fe9cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833198.527884:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833198.527886:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833198.527889:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833198.528187:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788833198.528208:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265909888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833198.528289:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833198.528502:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265909888 00000100:00100000:2.0:1788833198.528511:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265909888 00000100:00100000:2.0:1788833198.528555:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788833198.528581:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0677d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3278:x1875727265909888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788833198.528588:0:5797:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788833198 with bad export cookie 10090570562607769261 00000100:00100000:2.0:1788833198.536443:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0677d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3278:x1875727265909888:12345-0@lo:103:ldlm_bl.0 Request processed in 7854us (8145us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788833198.536460:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788833198.536609:0:3278:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788833198.536616:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9cea067f0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788833198.536621:0:3278:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788833198.546318:0:3278:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.155@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788833198.546327:0:3278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788833198.546340:0:3278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cea40eafb80 x1875727265909888/t0(0) o103->MGC192.168.206.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788833214 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788833198.546360:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788833198.546363:0:3278:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788833198.546365:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788833198.546369:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9cea067f0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788833198.546376:0:3278:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 113 00000100:00080000:1.0:1788833198.546423:0:3278:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import ffff9cea067f0000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1788833198.546661:0:3278:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce902701880 x1875727265910016/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788833198.546728:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3275:1875727265910016:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788833198.546799:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875727265910016 offset 0 length 520: 4 00000100:00100000:0.0:1788833198.546888:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3278:1875727265909888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788833199.085325:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788833199.725261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788833199.725280:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788833199.725346:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788833199.725366:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265910144:0@lo:400:kworker.0 00000400:00000100:2.0:1788833199.725428:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875727265910144 offset 0 length 224: 4 00010000:00010000:1.0:1788833200.111265:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788833200.282696:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788833200.282704:0:6679:0:(genops.c:885:class_export_put()) final put ffff9cea3f688000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788833200.282791:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f688000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788833200.282847:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3f68a000 for lustre-OST0000 00010000:00010000:2.0:1788833201.136789:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833202.157395:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833203.181462:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788833203.759019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788833203.759052:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788833203.759147:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265910272:0@lo:400:kworker.0 00000400:00000100:2.0:1788833203.759200:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875727265910272 offset 0 length 224: 4 00010000:00010000:0.0:1788833204.214490:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833205.229697:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833206.255610:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833207.277416:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833208.301713:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833208.941604:0:3275:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833198/real 1788833198] req@ffff9ce902701880 x1875727265910016/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788833208 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833208.941645:0:3275:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce902701880 x1875727265910016/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788833208 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833208.941662:0:3275:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833198/real 1788833198] req@ffff9cea3fb7f100 x1875727265909760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788833208 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833208.941677:0:3275:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cea3fb7f100 x1875727265909760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788833208 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788833208.941696:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea067f0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788833208.941720:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788833208.941724:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3275:1875727265910016:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788833208.941730:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea3f68f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788833208.941742:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875727265909760:0@lo:39:umount.0 00000100:00080000:2.0:1788833208.943800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788833208.943812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788833208.943817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cea067f0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788833208.943826:0:8:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 332 00000100:00080000:2.0:1788833208.943832:0:8:0:(import.c:589:import_select_connection()) MGC192.168.206.155@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788833208.943839:0:8:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import ffff9cea067f0000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833208.943877:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40eaf100 x1875727265910400/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788833208.943961:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833208.943976:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265910528:0@lo:400:kworker.0 00000400:00000100:2.0:1788833208.944057:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875727265910528 offset 0 length 224: 4 00000100:00100000:1.0:1788833208.944241:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3275:1875727265910400:0@lo:250:kworker.0 00000400:00000100:1.0:1788833208.944291:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875727265910400 offset 0 length 520: 4 00000100:00080000:3.0:1788833208.944825:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788833208.944831:0:13135:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788833208.944837:0:13135:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788833208.945707:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945723:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945730:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945737:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945768:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833208.945775:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945781:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945787:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945793:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833208.945803:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788833208.945807:0:13135:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788833208.945840:0:13135:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788833208.945844:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788833208.945848:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833208.945853:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788833208.945857:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9cea3f714d28) has no exports 00000020:00080000:3.0:1788833208.945879:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9cea3f714d28) has no exports 00000020:01000000:3.0:1788833208.947523:0:13135:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea06715480 - data ffff9cea2b45fbd0/ffff9cea3f572c00 00010000:00010000:1.0:1788833208.947772:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788833208.947782:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947793:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476800 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:1.0:1788833208.947797:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947807:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788833208.947814:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833208.947820:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788833208.947823:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788833208.947826:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788833208.947846:0:5801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cea067f0000 00010000:00010000:1.0:1788833208.947850:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947856:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476800/0x8c08e876ed3fe9d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fe9d9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947869:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833208.947873:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947878:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32477a00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:1.0:1788833208.947900:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947918:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788833208.947926:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833208.947931:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788833208.947933:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788833208.947936:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788833208.947942:0:5801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cea067f0000 00010000:00010000:1.0:1788833208.947945:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947950:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32477a00/0x8c08e876ed3fec09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fec10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833208.947960:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833208.947962:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833208.947964:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833208.949121:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788833208.957958:0:13135:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea26f483c0 - data ffff9cea2b683e58/ffff9cea3f67b800 00100000:10000000:1.0:1788833208.968483:0:13135:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788833209.016062:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe7e1 00000020:00000080:1.0:1788833209.016071:0:13135:0:(genops.c:885:class_export_put()) final put ffff9cea3f6f4800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788833209.016083:0:13135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea1fc5c800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788833209.016087:0:13135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea1fc5c800 2 00000020:01000004:1.0:1788833209.016090:0:13135:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cea1fc5c800 from lustre-OST0000 00000020:00000080:1.0:1788833209.016115:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788833209.016124:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788833209.016127:0:13135:0:(genops.c:885:class_export_put()) final put ffff9cea3f6f0800/lustre-OST0000_UUID 00000020:00000080:1.0:1788833209.016130:0:13135:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f6f0800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788833209.016150:0:13135:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788833209.016209:0:13135:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788833209.016213:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788833209.016217:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788833209.016221:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788833209.016227:0:13135:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cea3f68c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788833209.016233:0:13135:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9cea06993370) has exports, disconnecting them 00000020:00080000:1.0:1788833209.016238:0:13135:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cea3f68c000), last request at 1788832995 00000020:00000080:1.0:1788833209.016242:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe80b 00000020:00080000:1.0:1788833209.016250:0:13135:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cea3f68c000): rc 0 00000020:00000080:1.0:1788833209.016255:0:13135:0:(genops.c:885:class_export_put()) final put ffff9cea3f68c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788833209.016927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f6f4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788833209.016946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f68c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788833209.041187:0:13135:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788833209.041205:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788833209.041210:0:13135:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788833209.041217:0:13135:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788833209.041438:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788833209.041446:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788833209.041453:0:13135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea1fc5c800 1 00000020:00000080:2.0:1788833209.041459:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe79b 00000020:00000080:2.0:1788833209.041466:0:13135:0:(genops.c:885:class_export_put()) final put ffff9cea269a4800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788833209.041471:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788833209.041479:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788833209.041483:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788833209.041486:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9cea1f78b370) has no exports 00000020:00000080:3.0:1788833209.041606:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3f68f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788833209.041614:0:8:0:(genops.c:885:class_export_put()) final put ffff9cea3f68b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788833209.041617:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f68b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788833209.041626:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788833209.041683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea269a4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788833209.070154:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788833209.070170:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788833209.070175:0:13135:0:(genops.c:885:class_export_put()) final put ffff9cea067aa800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788833209.070180:0:13135:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea067aa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788833209.070201:0:13135:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788833209.070359:0:13135:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cea067ae000 00000020:02000400:3.0:1788833209.070406:0:13135:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788833209.333797:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833210.349857:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833211.376669:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788833212.223266:0:13289:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788833212.239213:0:13289:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788833212.242710:0:13289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833212.242728:0:13289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833212.242735:0:13289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833212.242759:0:13289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833212.242787:0:13289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788833212.242792:0:13289:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788833212.242819:0:13289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1788833212.242819:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833212.242829:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833212.242833:0:13289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cea40eac700 x1875727265910144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833215 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788833212.242848:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517000 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833212.242854:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833212.242862:0:13289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cea3fb7ce00 x1875727265910272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833219 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788833212.242864:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833212.242883:0:13289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cea40eaca80 x1875727265910528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833224 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:2.0:1788833212.242883:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833212.242902:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788833212.242906:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:3.0:1788833212.242916:0:13289:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:01000000:2.0:1788833212.242916:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:3.0:1788833212.242924:0:13289:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788833212.242931:0:5800:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cea067f0000 00010000:00010000:2.0:1788833212.242936:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833212.242944:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01517000/0x8c08e876ed3fe9a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fe9af expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788833212.242947:0:13289:0:(import.c:65:import_set_state_nolock()) ffff9cea3b3e0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788833212.242965:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833212.242967:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833212.242969:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833212.243071:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875727265910528:0@lo:400:kworker.0 00000100:00100000:1.0:1788833212.243109:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875727265910656:0@lo:39:umount.0 00000400:00000100:1.0:1788833212.243153:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875727265910656 offset 0 length 224: 4 00000100:00100000:0.0:1788833212.243174:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265910272:0@lo:400:kworker.0 00000100:00100000:0.0:1788833212.243187:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265910144:0@lo:400:kworker.0 00010000:00010000:0.0:1788833212.397280:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833213.421612:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788833214.062088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788833214.062099:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788833214.445228:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833215.470524:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833216.493352:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833217.517444:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833218.541477:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788833219.181910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788833219.181919:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788833219.565478:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833220.589421:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833221.613420:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833222.509393:0:3275:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833212/real 1788833212] req@ffff9cea3fb7e300 x1875727265910656/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788833222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833222.509448:0:3275:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cea3fb7e300 x1875727265910656/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788833222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788833222.509472:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea3b3e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788833222.509495:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875727265910656:0@lo:39:umount.0 00000100:00080000:3.0:1788833222.509664:0:13289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788833222.509671:0:13289:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788833222.509677:0:13289:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788833222.511386:0:13289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511410:0:13289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511603:0:13289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511635:0:13289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511665:0:13289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833222.511674:0:13289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511681:0:13289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511687:0:13289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511693:0:13289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833222.511775:0:13289:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788833222.511780:0:13289:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788833222.511805:0:13289:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788833222.511810:0:13289:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788833222.511815:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788833222.511822:0:13289:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788833222.511827:0:13289:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cea3f710000) has no exports 00000020:00080000:3.0:1788833222.511859:0:13289:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cea3f710000) has no exports 00010000:00010000:2.0:1788833222.515417:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833222.515439:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.515455:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517a00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833222.515460:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.515472:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833222.515479:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833222.515521:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788833222.515524:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788833222.515528:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788833222.515551:0:5800:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cea067f0000 00010000:00010000:2.0:1788833222.515555:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.515561:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01517a00/0x8c08e876ed3fe9b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fe9bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.515581:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833222.515584:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.515590:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea32476600 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833222.515593:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.516481:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833222.516489:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833222.516494:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788833222.516497:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788833222.516499:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788833222.516511:0:5800:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cea067f0000 00010000:00010000:2.0:1788833222.516514:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.516535:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476600/0x8c08e876ed3febfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fec02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.516556:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833222.516558:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833222.516561:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788833222.517311:0:13289:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea067153c0 - data ffff9cea33fd1ca8/ffff9cea3b3dac00 00000020:01000000:3.0:1788833222.517501:0:13289:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cea06715cc0 - data ffff9cea3fe23a20/ffff9cea3955fc00 00010000:00010000:0.0:1788833222.517887:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788833222.526981:0:13289:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788833222.564312:0:13289:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe8ac 00000020:00000080:2.0:1788833222.564328:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea068e8800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788833222.564349:0:13289:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea06626000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788833222.564353:0:13289:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea06626000 2 00000020:01000004:2.0:1788833222.564357:0:13289:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cea06626000 from lustre-OST0001 00000020:00000080:2.0:1788833222.564389:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788833222.564403:0:13289:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788833222.564407:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea068ed000/lustre-OST0001_UUID 00000020:00000080:2.0:1788833222.564410:0:13289:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea068ed000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788833222.564419:0:13289:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788833222.564715:0:13289:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 50e9edd7-a155-4c7b-bcad-c363b29ac1f4->MGS 00010000:00010000:2.0:1788833222.564733:0:13289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fe7c5 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833222.564748:0:13289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fe7c5 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833222.564756:0:13289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788833222.564758:0:13289:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788833222.564762:0:13289:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788833222.564779:0:13289:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cea067f0000 00010000:00010000:2.0:1788833222.564783:0:13289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea42167400/0x8c08e876ed3fe7be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fe7c5 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833222.564819:0:13289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c08e876ed3fea03 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833222.564826:0:13289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c08e876ed3fea03 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833222.564831:0:13289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788833222.564834:0:13289:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788833222.564835:0:13289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788833222.564844:0:13289:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cea067f0000 00010000:00010000:2.0:1788833222.564846:0:13289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea32476000/0x8c08e876ed3fe9fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c08e876ed3fea03 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788833222.564863:0:13289:0:(import.c:65:import_set_state_nolock()) ffff9cea067f0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788833222.564867:0:13289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788833222.564869:0:13289:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788833222.564870:0:13289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788833222.564875:0:13289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788833222.564888:0:13289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cea40eaf100 x1875727265910400/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788833223 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788833222.564908:0:13289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788833222.564911:0:13289:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:0.0:1788833222.564975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea068e8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788833222.566203:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e9edd7-a155-4c7b-bcad-c363b29ac1f4:3275:1875727265910400:0@lo:250:kworker.0 10000000:01000000:2.0:1788833222.566337:0:13289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788833222.566350:0:13289:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe69f 00000020:00000080:2.0:1788833222.566359:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea067f3000/50e9edd7-a155-4c7b-bcad-c363b29ac1f4 00000020:01000000:2.0:1788833222.566371:0:13289:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.155@tcp (flags='') 00000020:00000080:2.0:1788833222.566380:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788833222.566389:0:13289:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788833222.566395:0:13289:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9cea10ad4d28) has no exports 00000020:00000080:0.0:1788833222.566449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea067f3000/50e9edd7-a155-4c7b-bcad-c363b29ac1f4 for MGC192.168.206.155@tcp 10000000:01000000:1.0:1788833222.566692:0:5809:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788833222.566808:0:13289:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.155@tcp: client import never connected 00000100:00080000:2.0:1788833222.566831:0:13289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788833222.566834:0:13289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788833222.566838:0:13289:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788833222.566840:0:13289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788833222.566894:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788833222.566903:0:13289:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.155@tcp (uuid 50e9edd7-a155-4c7b-bcad-c363b29ac1f4) 00000020:01000000:2.0:1788833222.566908:0:13289:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788833222.566912:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788833222.566917:0:13289:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788833222.566923:0:13289:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cea3f6f2800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788833222.566928:0:13289:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9cea068a0000) has exports, disconnecting them 00000020:00080000:2.0:1788833222.566933:0:13289:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cea3f6f2800), last request at 1788833013 00000020:00000080:2.0:1788833222.566948:0:13289:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe8d6 00000020:00080000:2.0:1788833222.566962:0:13289:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cea3f6f2800): rc 0 00000020:00000080:2.0:1788833222.566966:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea3f6f2800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788833222.567767:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea067f0000 for MGC192.168.206.155@tcp 00000020:00000080:0.0:1788833222.567778:0:36:0:(genops.c:885:class_export_put()) final put ffff9cea067f2800/50e9edd7-a155-4c7b-bcad-c363b29ac1f4 00000020:00000080:0.0:1788833222.567781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea067f2800/50e9edd7-a155-4c7b-bcad-c363b29ac1f4 for MGC192.168.206.155@tcp 00000020:01000000:0.0:1788833222.567787:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.155@tcp (50e9edd7-a155-4c7b-bcad-c363b29ac1f4) 00000020:00000080:0.0:1788833222.568115:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea3f6f2800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788833222.569266:0:13289:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788833222.569282:0:13289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788833222.569288:0:13289:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788833222.569296:0:13289:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788833222.569369:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788833222.569549:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cea3b3e0800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788833222.574233:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788833222.574470:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788833222.574684:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cea0661d200:5795] 0 exiting: rc = 1 00000100:00100000:3.0:1788833222.575082:0:7599:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9cea3f624600:7599] 2 exiting: rc = 0 00000100:00100000:3.0:1788833222.575152:0:5796:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cea066b6a00:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1788833222.575295:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.575661:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9cea05ce3800:5798] 1 exiting: rc = 0 00000100:00100000:0.0:1788833222.575827:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cea05ce2800:5799] 2 exiting: rc = 0 00000100:00100000:0.0:1788833222.578212:0:8413:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cea10e63a00:8413] 3 exiting: rc = 0 00000100:00100000:0.0:1788833222.578464:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cea05ce3000:5797] 0 exiting: rc = 1 00000100:00100000:1.0:1788833222.578590:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578601:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578608:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578614:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578620:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578627:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578638:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578645:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578652:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578660:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578667:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578673:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578679:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578684:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578690:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578696:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578702:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578709:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578717:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578722:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578727:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578733:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578738:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578743:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578749:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578754:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578759:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578763:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578768:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578773:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578778:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578782:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578787:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578791:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578796:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578815:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578820:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578825:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578830:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578835:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578840:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578845:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578850:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578855:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578860:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578866:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578871:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578876:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578880:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578885:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578890:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578895:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578899:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578904:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578908:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578913:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578918:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578922:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578927:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578933:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578939:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578943:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578947:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.578952:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788833222.579894:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788833222.579905:0:13289:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788833222.579912:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea125d8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788833222.579917:0:13289:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea125d8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788833222.579923:0:13289:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788833222.579978:0:13289:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea06626000 1 00000020:00000080:1.0:1788833222.579984:0:13289:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8c08e876ed3fe87b 00000020:00000080:1.0:1788833222.579991:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea125da800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788833222.580008:0:13289:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788833222.580012:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788833222.580017:0:13289:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788833222.580021:0:13289:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9cea3f713370) has no exports 00000020:00000080:0.0:1788833222.580429:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea125da800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788833222.604439:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788833222.604462:0:13289:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788833222.604470:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea06626800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788833222.604475:0:13289:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea06626800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788833222.604489:0:13289:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788833222.604703:0:13289:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cea06624000 00000020:01000000:2.0:1788833222.604737:0:13289:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788833222.604743:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788833222.604748:0:13289:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788833222.604753:0:13289:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9cea069919b8) has no exports 00000020:00000080:2.0:1788833222.604789:0:13289:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788833222.604796:0:13289:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788833222.604800:0:13289:0:(genops.c:885:class_export_put()) final put ffff9cea269a3000/OSS_uuid 00000020:00000080:2.0:1788833222.604802:0:13289:0:(genops.c:844:class_export_destroy()) destroying export ffff9cea269a3000/OSS_uuid for OSS 00000020:01000000:2.0:1788833222.604806:0:13289:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788833222.604836:0:5808:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788833222.605110:0:6656:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9cea27202200:6656] 2 exiting: rc = 0 00000100:00100000:0.0:1788833222.608166:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9cea10ee7e00:8426] 3 exiting: rc = 0 00000100:00100000:0.0:1788833222.608298:0:6654:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9cea1f599600:6654] 0 exiting: rc = 1 00000100:00100000:0.0:1788833222.608360:0:6655:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9cea27203a00:6655] 1 exiting: rc = 0 00000100:00100000:3.0:1788833222.609219:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609232:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609247:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609255:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609261:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609267:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609273:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609289:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609295:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609300:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609555:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609563:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609569:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609574:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609580:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609586:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609592:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609598:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609605:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609611:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609617:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609623:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609630:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609636:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609642:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609648:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609654:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609660:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609666:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609672:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609679:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609685:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609690:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609697:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609703:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609725:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609730:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609736:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609762:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609769:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609775:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609780:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609785:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609790:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609796:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609803:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609809:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609815:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609820:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609827:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609833:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609839:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609845:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609851:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609860:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609866:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609871:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609877:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609883:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609892:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609899:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609905:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609910:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.609917:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.615450:0:12183:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9cea094e3000:12183] 2 exiting: rc = 0 00000100:00100000:0.0:1788833222.615554:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9cea1f5a6400:6658] 1 exiting: rc = 0 00000100:00100000:0.0:1788833222.616100:0:6657:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cea095f9200:6657] 0 exiting: rc = 1 00000100:00100000:3.0:1788833222.616450:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616463:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616469:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616475:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616482:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616489:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616518:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616524:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616530:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616536:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616541:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616547:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616554:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616560:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616566:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616571:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616577:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616655:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616663:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616669:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616674:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616681:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616686:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616692:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616698:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616703:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616708:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616713:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616719:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616725:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616731:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616736:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616742:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616749:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616816:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616824:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616830:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616835:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616841:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616846:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616851:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616865:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616870:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616876:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616882:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616889:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616894:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616900:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616905:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616915:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616921:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616931:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.616997:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617006:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617012:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617018:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617023:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617716:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617730:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617736:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617742:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617747:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617764:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.617771:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.621000:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cea27007e00:6659] 0 exiting: rc = 1 00000100:00100000:3.0:1788833222.621458:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9cea095f8a00:6661] 2 exiting: rc = 0 00000100:00100000:1.0:1788833222.621811:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9cea095f8c00:6660] 1 exiting: rc = 0 00000100:00100000:3.0:1788833222.621934:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621944:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621951:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621957:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621964:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621970:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621976:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621983:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621989:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.621995:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622001:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622024:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622049:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622056:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622062:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622069:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622075:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622082:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622089:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622107:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622115:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622135:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622141:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622148:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622154:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622159:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622166:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622174:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622181:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622187:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622194:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622202:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622209:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622216:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622222:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622229:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622235:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622243:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622250:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622259:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622265:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622271:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622287:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622311:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622319:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622325:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622338:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622344:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622350:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622358:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622365:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622373:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622380:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622389:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622395:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622402:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622418:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622426:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622432:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622438:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622444:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622458:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622466:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.622472:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.632111:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cea05ca7600:6662] 0 exiting: rc = 1 00000100:00100000:0.0:1788833222.632591:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cea05ca7400:6663] 1 exiting: rc = 0 00000100:00100000:3.0:1788833222.632840:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.632849:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635637:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635646:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635653:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635661:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635667:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635674:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635681:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635686:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635693:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635699:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635705:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635711:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635718:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635724:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635730:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635974:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635980:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635987:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635992:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.635998:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636005:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636011:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636016:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636021:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636027:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636284:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636291:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636364:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636374:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636380:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636387:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636393:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636399:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636405:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636412:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636418:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636423:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636431:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636437:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636442:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636448:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636453:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636459:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636465:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636471:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636477:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636483:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636489:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636494:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636501:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636518:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636525:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636532:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636539:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636545:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636551:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636557:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636562:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636567:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636573:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636578:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.636584:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788833222.642854:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9cea05ca6200:6665] 1 exiting: rc = 0 00000100:00100000:3.0:1788833222.644004:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cea27006800:6664] 0 exiting: rc = 1 00000100:00100000:1.0:1788833222.644179:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644190:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644198:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644206:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644212:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644218:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644248:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644256:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644262:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644269:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644286:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644293:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644301:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644307:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644314:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644320:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644326:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644333:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644355:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644363:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644369:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644375:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644399:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644406:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644414:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644422:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644428:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644434:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644440:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644446:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644467:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644475:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644481:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644487:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644496:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644503:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644509:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644516:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644522:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644529:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644536:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644543:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644565:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644574:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644580:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644601:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644608:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644614:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644622:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644628:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644635:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644641:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644649:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644655:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644678:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644686:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644693:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644707:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644714:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644720:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644727:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644734:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644742:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788833222.644751:0:13289:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788833222.658843:0:13289:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788833239.326298:0:13910:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788833248.308475:0:14371:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788833248.308480:0:14371:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788833248.308590:0:14371:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cea3f68e000 00000020:01000004:3.0:1788833248.308603:0:14371:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788833248.308611:0:14371:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788833248.308635:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9cea06993370) 00000020:00000080:3.0:1788833248.308648:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788833248.335659:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788833248.338775:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788833248.339227:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 389: rc = 0 00100000:10000000:2.0:1788833248.339334:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 389: rc = 0 00100000:10000000:2.0:1788833248.339437:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 389: rc = 0 00100000:10000000:2.0:1788833248.342480:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788833248.344878:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 389: rc = 0 00100000:10000000:2.0:1788833248.345138:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 389: rc = 0 00100000:10000000:2.0:1788833248.345255:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 389: rc = 0 00100000:10000000:2.0:1788833248.345550:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 513: rc = 0 00100000:10000000:3.0:1788833248.351138:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 209: rc = 0 00100000:10000000:3.0:1788833248.351257:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 209: rc = 0 00100000:10000000:3.0:1788833248.351793:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 653: rc = 0 00100000:10000000:3.0:1788833248.352228:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 653: rc = 0 00100000:10000000:3.0:1788833248.352450:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 653: rc = 0 00100000:10000000:3.0:1788833248.352796:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 653: rc = 0 00100000:10000000:3.0:1788833248.353069:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 653: rc = 0 00100000:10000000:3.0:1788833248.353346:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 653: rc = 0 00100000:10000000:3.0:1788833248.353572:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 653: rc = 0 00100000:10000000:3.0:1788833248.353897:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 653: rc = 0 00100000:10000000:3.0:1788833248.354461:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 653: rc = 0 00100000:10000000:3.0:1788833248.354911:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 653: rc = 0 00100000:10000000:3.0:1788833248.355202:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 653: rc = 0 00100000:10000000:3.0:1788833248.355454:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 653: rc = 0 00100000:10000000:3.0:1788833248.356174:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 406: rc = 0 00100000:10000000:3.0:1788833248.356433:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 406: rc = 0 00100000:10000000:3.0:1788833248.356740:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 406: rc = 0 00100000:10000000:3.0:1788833248.356995:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 406: rc = 0 00100000:10000000:3.0:1788833248.357281:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 406: rc = 0 00100000:10000000:3.0:1788833248.357522:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 406: rc = 0 00100000:10000000:3.0:1788833248.357957:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 406: rc = 0 00100000:10000000:3.0:1788833248.358353:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 406: rc = 0 00100000:10000000:3.0:1788833248.358703:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 406: rc = 0 00100000:10000000:3.0:1788833248.359024:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 406: rc = 0 00100000:10000000:3.0:1788833248.359293:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 406: rc = 0 00100000:10000000:3.0:1788833248.359531:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 406: rc = 0 00100000:10000000:3.0:1788833248.364104:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 406: rc = 0 00100000:10000000:3.0:1788833248.364410:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 406: rc = 0 00100000:10000000:3.0:1788833248.364682:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 406: rc = 0 00100000:10000000:3.0:1788833248.364923:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 406: rc = 0 00100000:10000000:2.0:1788833248.365484:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 406: rc = 0 00100000:10000000:2.0:1788833248.365808:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 406: rc = 0 00100000:10000000:2.0:1788833248.366158:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 406: rc = 0 00100000:10000000:2.0:1788833248.366390:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 406: rc = 0 00100000:10000000:2.0:1788833248.367952:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 406: rc = 0 00100000:10000000:2.0:1788833248.368337:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 406: rc = 0 00100000:10000000:2.0:1788833248.368579:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 406: rc = 0 00100000:10000000:2.0:1788833248.371882:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 406: rc = 0 00100000:10000000:2.0:1788833248.374356:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 406: rc = 0 00100000:10000000:2.0:1788833248.375240:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 406: rc = 0 00100000:10000000:2.0:1788833248.375510:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 406: rc = 0 00100000:10000000:2.0:1788833248.376384:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 406: rc = 0 00100000:10000000:1.0:1788833248.381253:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 406: rc = 0 00100000:10000000:1.0:1788833248.381573:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 406: rc = 0 00100000:10000000:1.0:1788833248.382074:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 406: rc = 0 00100000:10000000:1.0:1788833248.382339:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 406: rc = 0 00100000:10000000:1.0:1788833248.384913:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 395: rc = 0 00100000:10000000:1.0:1788833248.385493:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788833248.387897:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 210: rc = 0 00100000:10000000:1.0:1788833248.389106:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788833248.389240:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 210: rc = 0 00100000:10000000:1.0:1788833248.389457:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788833248.389527:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 210: rc = 0 00100000:10000000:1.0:1788833248.389929:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788833248.389996:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 393: rc = 0 00100000:10000000:1.0:1788833248.390238:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788833248.390312:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 393: rc = 0 00100000:10000000:1.0:1788833248.390502:0:14371:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788833248.390573:0:14371:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 393: rc = 0 00000020:00000080:1.0:1788833248.390828:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788833248.390835:0:14371:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788833248.390845:0:14371:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3ff9a0 00000020:01000004:1.0:1788833248.390852:0:14371:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788833248.390862:0:14371:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788833248.390866:0:14371:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cea3f68e000 from MGS 00000020:01000004:1.0:1788833248.390870:0:14371:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788833248.390879:0:14371:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cea068a0000) 00000020:00000080:1.0:1788833248.390889:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788833248.390938:0:14371:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea3f68e000 from MGS, refs=2 00080000:01000000:1.0:1788833248.390943:0:14371:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788833248.390948:0:14371:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3ff9ae 00000100:00100000:1.0:1788833248.391068:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788833248.391234:0:14371:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788833248.391240:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788833248.393225:0:14371:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788833248.393235:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788833248.393985:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833248.394315:0:14371:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788833248.394320:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788833248.394990:0:14371:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788833248.394998:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788833248.395412:0:14371:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788833248.395419:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788833248.403983:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833248.403989:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833248.403992:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833248.405778:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833248.405784:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833248.405787:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833248.406754:0:14371:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788833248.425793:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788833248.434523:0:14371:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788833248.434541:0:14371:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788833248.434543:0:14371:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788833248.436390:0:14380:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788833248.436530:0:14371:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788833248.436636:0:14371:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788833248.437416:0:14371:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788833248.437740:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788833248.437912:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788833248.437924:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788833248.443217:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788833248.443228:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788833248.443556:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788833248.443563:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788833248.444942:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788833248.444971:0:14371:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.155@tcp' 00000020:01000004:0.0:1788833248.444973:0:14371:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788833248.445010:0:14371:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.155@tcp (typ=mgc) 00000020:00000080:0.0:1788833248.445022:0:14371:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.155@tcp (ffff9cea3f713370) 00000020:00000080:0.0:1788833248.445056:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788833248.445132:0:14371:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea0518a800@MGC192.168.206.155@tcp: add connection 192.168.206.155@tcp at head 00010000:00010000:0.0:1788833248.445290:0:14371:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.155@tcp-0 is initialized 00000040:01000000:0.0:1788833248.445296:0:14371:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788833248.445849:0:14384:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788833248.454728:0:14385:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788833248.461841:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.155@tcp (uuid 2b1386bc-e40b-4aca-a224-131a3ddd4df1) 00000020:00000080:0.0:1788833248.461868:0:14371:0:(genops.c:1385:class_connect()) connect: client 2b1386bc-e40b-4aca-a224-131a3ddd4df1, cookie 0x8c08e876ed3ff9bc 00000100:00080000:0.0:1788833248.461879:0:14371:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788833248.461885:0:14371:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import ffff9cea0518a800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1788833248.461919:0:14371:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce902703b80 x1875727265910784/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788833248.461964:0:14371:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2b1386bc-e40b-4aca-a224-131a3ddd4df1->MGS 00000020:01000004:0.0:1788833248.461994:0:14371:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788833248.461999:0:14371:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788833248.462013:0:14371:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9cea3f710000) 00000020:00000080:0.0:1788833248.462026:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788833248.466789:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3275:1875727265910784:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788833248.466864:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833248.466941:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265910784 00000100:00100000:1.0:1788833248.466949:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265910784 00000100:00100000:1.0:1788833248.466979:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833248.466985:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3275:x1875727265910784:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788833248.467010:0:14381:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2b1386bc-e40b-4aca-a224-131a3ddd4df1@0@lo t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:1.0:1788833248.467056:0:14381:0:(genops.c:1385:class_connect()) connect: client 2b1386bc-e40b-4aca-a224-131a3ddd4df1, cookie 0x8c08e876ed3ff9ca 00000100:00080000:1.0:1788833248.467194:0:14381:0:(import.c:65:import_set_state_nolock()) ffff9cea2ae0c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833248.467248:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+5:3275:x1875727265910784:12345-0@lo:250:mount.lustre.0 Request processed in 261us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833248.467256:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833248.467295:0:3275:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788833248.467302:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.155@tcp: connect to target with instance 0 00000100:00080000:1.0:1788833248.467309:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788833248.467313:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788833248.467316:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea0518a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788833248.467318:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788833248.467324:0:3275:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788833248.467329:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3275:1875727265910784:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788833248.476186:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788833248.476363:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788833248.476369:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788833248.477522:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788833248.477532:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788833248.478000:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788833248.478007:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788833248.478939:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788833248.479180:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788833248.479186:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788833248.484601:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788833248.484690:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788833248.516870:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833248.517275:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788833248.517282:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788833248.519302:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788833248.519314:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788833248.519963:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833248.520293:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788833248.520300:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788833248.520859:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788833248.520868:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788833248.521485:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833248.521654:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788833248.521660:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788833248.522133:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788833248.522139:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788833248.522777:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833248.522921:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788833248.522926:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788833248.523516:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788833248.523522:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788833248.539432:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788833248.539747:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788833248.539754:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788833248.541397:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788833248.541411:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788833248.542196:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788833248.542204:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788833248.543881:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788833248.543904:0:14371:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788833248.543910:0:14371:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788833248.544275:0:14371:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788833248.544317:0:14371:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.155@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788833248.544322:0:14371:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788833248.544323:0:14371:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788833248.544324:0:14371:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833248.544325:0:14371:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833248.544331:0:14371:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833248.544332:0:14371:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833248.544334:0:14371:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788833248.544335:0:14371:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788833248.544337:0:14371:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833248.544338:0:14371:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788833248.544341:0:14371:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788833248.544343:0:14371:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788833248.544344:0:14371:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788833248.544345:0:14371:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833248.544346:0:14371:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833248.544347:0:14371:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833248.544348:0:14371:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833248.544349:0:14371:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788833248.544350:0:14371:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788833248.544351:0:14371:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833248.544351:0:14371:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788833248.544379:0:14371:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788833248.544399:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265910912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788833248.544470:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.544556:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833248.544666:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265910912 00000100:00100000:0.0:1788833248.544673:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265910912 00000100:00100000:0.0:1788833248.544755:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833248.544765:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+5:14371:x1875727265910912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788833248.544803:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788833248.544806:0:14383:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788833248.544809:0:14383:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788833248.545166:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788833248.545533:0:14383:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788833248.546718:0:14406:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788833248.546725:0:14406:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788833248.546728:0:14406:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788833248.546763:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788833248.547190:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788833248.547201:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788833248.552720:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+5:14371:x1875727265910912:12345-0@lo:253:mount.lustre.0 Request processed in 7947us (8239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833248.552741:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833248.553239:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265910912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788833248.553255:0:14371:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788833248.553259:0:14371:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788833248.553261:0:14371:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788833248.553263:0:14371:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833248.553264:0:14371:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833248.553265:0:14371:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833248.553266:0:14371:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833248.553268:0:14371:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788833248.553269:0:14371:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788833248.553271:0:14371:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833248.553286:0:14371:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788833248.553307:0:14371:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cea3f68e000 from lustre-MDT0000 10000000:01000000:2.0:1788833248.553335:0:14371:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788833248.553338:0:14371:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788833248.553342:0:14371:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cea3f713370 10000000:01000000:2.0:1788833248.553346:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788833248.553354:0:14371:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cea3f713370 from 1 10000000:01000000:2.0:1788833248.553357:0:14371:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788833248.553398:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.553409:0:14371:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.553418:0:14371:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833248.553440:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833248.553478:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.553523:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:3.0:1788833248.553672:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265911040 00000100:00100000:3.0:1788833248.553679:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265911040 00000100:00100000:3.0:1788833248.553729:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833248.553739:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+5:14371:x1875727265911040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833248.553751:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833248.553765:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3ff9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ff9d1 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833248.553802:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3ff9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ff9d1 expref: 6 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833248.553812:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517e00/0x8c08e876ed3ff9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ff9d1 expref: 6 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833248.553821:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517e00, rc 0) 00000100:00100000:3.0:1788833248.553902:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+6:14371:x1875727265911040:12345-0@lo:101:mount.lustre.0 Request processed in 164us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833248.553909:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788833248.554175:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833248.554190:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.554198:0:14371:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833248.554245:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833248.554272:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.554342:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:3.0:1788833248.554381:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265911168 00000100:00100000:3.0:1788833248.554386:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265911168 00000100:00100000:3.0:1788833248.554457:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788833248.554465:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+6:14371:x1875727265911168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833248.554791:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+6:14371:x1875727265911168:12345-0@lo:501:mount.lustre.0 Request processed in 326us (516us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788833248.554798:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833248.554858:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911168:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788833248.554889:0:14371:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788833248.554944:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.554953:0:14371:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833248.554960:0:14371:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cea3f68e000 10000000:01000000:2.0:1788833248.554965:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788833248.554968:0:14371:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cea3f68e000 10000000:01000000:2.0:1788833248.554971:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788833248.554973:0:14371:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cea3f68e000 from 1 10000000:01000000:2.0:1788833248.554975:0:14371:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788833248.555004:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037400/0x8c08e876ed3ff9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.555011:0:14371:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea1f037400/0x8c08e876ed3ff9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.555019:0:14371:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea1f037400/0x8c08e876ed3ff9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833248.555049:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833248.555074:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.555096:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833248.555214:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265911296 00000100:00100000:0.0:1788833248.555219:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265911296 00000100:00100000:0.0:1788833248.555247:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788833248.555254:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+6:14371:x1875727265911296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833248.555262:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833248.555275:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea0925a800/0x8c08e876ed3ff9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ff9df expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.555294:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea0925a800/0x8c08e876ed3ff9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ff9df expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.555303:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea0925a800/0x8c08e876ed3ff9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ff9df expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.555322:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a800, rc 0) 00000100:00100000:0.0:1788833248.555361:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+7:14371:x1875727265911296:12345-0@lo:101:mount.lustre.0 Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833248.555367:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833248.555437:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833248.555449:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea1f037400/0x8c08e876ed3ff9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9e6 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.555468:0:14371:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037400/0x8c08e876ed3ff9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ff9e6 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833248.555481:0:14371:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788833248.555571:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037400/0x8c08e876ed3ff9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9e6 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.555579:0:14371:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f037400/0x8c08e876ed3ff9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9e6 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833248.555594:0:14371:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788833248.555598:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788833248.555603:0:14371:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cea3f68e000 10000000:01000000:2.0:1788833248.555605:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788833248.555608:0:14371:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788833248.555610:0:14371:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788833248.555624:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f036c00/0x8c08e876ed3ff9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.555631:0:14371:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea1f036c00/0x8c08e876ed3ff9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.555638:0:14371:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea1f036c00/0x8c08e876ed3ff9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833248.555650:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833248.555674:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.555705:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833248.555820:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265911424 00000100:00100000:0.0:1788833248.555824:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265911424 00000100:00100000:0.0:1788833248.555867:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788833248.555874:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+7:14371:x1875727265911424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833248.555881:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833248.555889:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea0925aa00/0x8c08e876ed3ff9f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ff9ed expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.555904:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea0925aa00/0x8c08e876ed3ff9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ff9ed expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.555912:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea0925aa00/0x8c08e876ed3ff9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ff9ed expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.555918:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925aa00, rc 0) 00000100:00100000:0.0:1788833248.555953:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+8:14371:x1875727265911424:12345-0@lo:101:mount.lustre.0 Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833248.555958:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833248.556228:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833248.556241:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea1f036c00/0x8c08e876ed3ff9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9f4 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.556249:0:14371:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea1f036c00/0x8c08e876ed3ff9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ff9f4 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833248.556293:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833248.556319:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.556339:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:1.0:1788833248.556466:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265911552 00000100:00100000:1.0:1788833248.556471:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265911552 00000100:00100000:1.0:1788833248.556502:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788833248.556509:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+8:14371:x1875727265911552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833248.557214:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14371:x1875727265911552:12345-0@lo:501:mount.lustre.0 Request processed in 703us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833248.557222:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833248.557282:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833248.557315:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788833248.557356:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.557447:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea40f23180 going to sleep for 11 seconds 00000100:00100000:3.0:1788833248.557482:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265911680 00000100:00100000:3.0:1788833248.557487:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265911680 00000100:00100000:3.0:1788833248.557562:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788833248.557571:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14371:x1875727265911680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788833248.557873:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14371:x1875727265911680:12345-0@lo:503:mount.lustre.0 Request processed in 303us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833248.557880:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833248.557946:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265911680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833248.558360:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14407:1875727265911808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833248.558400:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833248.559195:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265911808 00000100:00100000:0.0:1788833248.559204:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265911808 00000100:00100000:1.0:1788833248.559223:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f2213c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833248.559249:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788833248.559259:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14407:x1875727265911808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788833248.559655:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14407:x1875727265911808:12345-0@lo:502:llog_process_th.0 Request processed in 396us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833248.559671:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788833248.559692:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14407:1875727265911808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788833248.559725:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833248.559736:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.559738:0:14407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788833248.559743:0:14407:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788833248.559746:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788833248.559760:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cea068a3370) 00000020:00000080:1.0:1788833248.559784:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788833248.559792:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788833248.559856:0:14407:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788833248.559865:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3ffa02 00000020:00000080:1.0:1788833248.560126:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788833248.560131:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833248.560135:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.560136:0:14407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788833248.560139:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833248.560154:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.560156:0:14407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788833248.560160:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788833248.560167:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cea068a19b8) 00000020:00000080:1.0:1788833248.560178:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788833248.560182:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788833248.560184:0:14407:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788833248.560186:0:14407:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788833248.560192:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788833248.560230:0:14407:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea3f68e000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788833248.560243:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cea068a4d28) 00000020:00000080:1.0:1788833248.560250:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788833248.560307:0:14407:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788833248.560315:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3ffa17 00000020:00000080:1.0:1788833248.560410:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788833248.560416:0:14407:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788833248.560421:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8c08e876ed3ffa1e 00080000:01000000:1.0:1788833248.560426:0:14407:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788833248.560429:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3ffa25 00010000:00010000:0.0:1788833248.636788:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788833248.637233:0:14407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1788833248.637404:0:14407:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788833248.641966:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9cea3f714d28) 00000020:00000080:0.0:1788833248.642087:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788833248.642191:0:14407:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788833248.642198:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3ffa33 00000020:00000080:0.0:1788833248.650423:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788833248.656839:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8c08e876ed3ffa3a 00000020:00000080:2.0:1788833248.657926:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788833248.657941:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833248.657948:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.657950:0:14407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788833248.657953:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833248.657958:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.657959:0:14407:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788833248.657963:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788833248.658016:0:14407:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788833248.658066:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833248.658070:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.658072:0:14407:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788833248.658074:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788833248.658084:0:14407:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788833248.658086:0:14407:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788833248.658088:0:14407:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788833248.658090:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788833248.658093:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.658094:0:14407:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788833248.658097:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788833248.658100:0:14407:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788833248.658104:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.658105:0:14407:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788833248.658108:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788833248.658112:0:14407:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:2.0:1788833248.658135:0:14407:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788833248.658138:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788833248.658163:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cea1f78cd28) 00000020:00000080:2.0:1788833248.658179:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788833248.658184:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788833248.658246:0:14407:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788833248.658251:0:14407:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788833248.658256:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3ffa48 00010000:00080000:2.0:1788833248.658283:0:14407:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce9020d5800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1788833248.658484:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788833248.662283:0:14407:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788833248.662333:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788833248.663561:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833248.663624:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788833248.663704:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788833248.664436:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788833248.664446:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788833248.665703:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788833248.665716:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788833248.665751:0:14407:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788833248.665769:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3ffa4f 00000100:00080000:2.0:1788833248.665779:0:14407:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788833248.665784:0:14407:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce9020d5800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833248.665818:0:14407:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40eadf80 x1875727265911936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788833248.665844:0:14407:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788833248.665955:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265911936:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788833248.666018:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875727265911936 offset 0 length 520: 4 00000020:01000000:2.0:1788833248.667530:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833248.667538:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.667540:0:14407:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788833248.667544:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788833248.667546:0:14407:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788833248.667548:0:14407:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788833248.667549:0:14407:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788833248.667551:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788833248.667553:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.667555:0:14407:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788833248.667557:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788833248.667561:0:14407:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788833248.667564:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.667566:0:14407:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788833248.667569:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788833248.667572:0:14407:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:2.0:1788833248.667595:0:14407:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788833248.667598:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788833248.667614:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cea1f78b370) 00000020:00000080:2.0:1788833248.667634:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788833248.667638:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788833248.667720:0:14407:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788833248.667726:0:14407:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788833248.667733:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c08e876ed3ffa5d 00010000:00080000:2.0:1788833248.667770:0:14407:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea0350c800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1788833248.667983:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788833248.669870:0:14407:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788833248.669899:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788833248.671759:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788833248.671855:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788833248.671930:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788833248.676462:0:14413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788833248.676469:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788833248.677347:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788833248.677358:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788833248.677390:0:14407:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788833248.677406:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3ffa64 00000100:00080000:1.0:1788833248.677415:0:14407:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788833248.677420:0:14407:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cea0350c800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1788833248.677463:0:14407:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea05ca8700 x1875727265912064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788833248.677491:0:14407:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788833248.677543:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833248.677547:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.677549:0:14407:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788833248.677563:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833248.677568:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.677569:0:14407:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788833248.677573:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788833248.677574:0:14407:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788833248.677577:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833248.677579:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.677580:0:14407:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788833248.677582:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833248.677584:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.677585:0:14407:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788833248.677589:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788833248.678105:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265912064:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788833248.678190:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875727265912064 offset 0 length 520: 4 00000100:00100000:1.0:1788833248.678397:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14407:1875727265912192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833248.678500:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833248.678517:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea01254a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.679250:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265912192 00000100:00100000:2.0:1788833248.679268:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265912192 00000100:00100000:2.0:1788833248.679327:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833248.679337:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14407:x1875727265912192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833248.679606:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14407:x1875727265912192:12345-0@lo:502:llog_process_th.0 Request processed in 270us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.679614:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788833248.679733:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14407:1875727265912192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788833248.679764:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833248.679772:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833248.679774:0:14407:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788833248.679779:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788833248.679989:0:14371:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788833248.680016:0:14371:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788833248.680089:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f036c00/0x8c08e876ed3ff9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9f4 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.680099:0:14371:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f036c00/0x8c08e876ed3ff9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9f4 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833248.680107:0:14371:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea3f68e000 from 1 10000000:01000000:2.0:1788833248.680110:0:14371:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788833248.680137:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.680156:0:14371:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.680165:0:14371:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833248.680184:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833248.680218:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.680253:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f98c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788833248.681014:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265912320 00000100:00100000:0.0:1788833248.681022:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265912320 00000100:00100000:0.0:1788833248.681084:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833248.681093:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+9:14371:x1875727265912320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833248.681105:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833248.681121:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffa6b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.681154:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.681166:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.681190:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ba00, rc 0) 00000100:00100000:0.0:1788833248.681246:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+10:14371:x1875727265912320:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833248.681252:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788833248.681386:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833248.681401:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833248.681415:0:14371:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833248.681987:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912448:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788833248.682427:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833248.682508:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788833248.683437:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265912448 00000100:00100000:1.0:1788833248.683446:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265912448 00000100:00100000:1.0:1788833248.683499:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788833248.683508:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+10:14371:x1875727265912448:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788833248.683530:0:14381:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788833248.683537:0:14381:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788833248.683881:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+10:14371:x1875727265912448:12345-0@lo:256:mount.lustre.0 Request processed in 374us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833248.683890:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788833248.683993:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912448:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788833248.685470:0:14371:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788833248.685819:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833248.685833:0:14371:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833248.685841:0:14371:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea3f68e000 from 1 10000000:01000000:3.0:1788833248.685844:0:14371:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833248.685885:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833248.685893:0:14371:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833248.685905:0:14371:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833248.685926:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788833248.685981:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833248.687086:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3fc7f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.687222:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265912576 00000100:00100000:2.0:1788833248.687236:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265912576 00000100:00100000:2.0:1788833248.687289:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833248.687298:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+10:14371:x1875727265912576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833248.687311:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833248.687328:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffa79 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.687352:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.687363:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.687371:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f037800, rc 0) 00000100:00100000:2.0:1788833248.687516:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14371:x1875727265912576:12345-0@lo:101:mount.lustre.0 Request processed in 219us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.687524:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788833248.687592:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833248.687608:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.687617:0:14371:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833248.687688:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833248.687719:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833248.687741:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea27f8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833248.687786:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265912704 00000100:00100000:1.0:1788833248.687791:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265912704 00000100:00100000:1.0:1788833248.687827:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788833248.687834:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14371:x1875727265912704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833248.688269:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14371:x1875727265912704:12345-0@lo:501:mount.lustre.0 Request processed in 434us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833248.688277:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788833248.688761:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833248.688798:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833248.688846:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833248.688882:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea27f8ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.688942:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265912832 00000100:00100000:2.0:1788833248.688947:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265912832 00000100:00100000:2.0:1788833248.688988:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788833248.688996:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14371:x1875727265912832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788833248.689191:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14371:x1875727265912832:12345-0@lo:503:mount.lustre.0 Request processed in 195us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.689199:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788833248.689280:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265912832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788833248.690177:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14415:1875727265912960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833248.690229:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.690269:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f98ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788833248.690285:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265912960 00000100:00100000:3.0:1788833248.690291:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265912960 00000100:00100000:3.0:1788833248.690337:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788833248.690346:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14415:x1875727265912960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788833248.690588:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14415:x1875727265912960:12345-0@lo:502:llog_process_th.0 Request processed in 243us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833248.690597:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788833248.691054:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14415:1875727265912960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833248.691093:0:14415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833248.691102:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.691105:0:14415:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788833248.691112:0:14415:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea3f68e000 00000020:00000080:2.0:1788833248.691115:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833248.691122:0:14415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833248.691125:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.691126:0:14415:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788833248.691129:0:14415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833248.691131:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.691132:0:14415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788833248.691135:0:14415:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea3f68e000 00000020:00000080:2.0:1788833248.691137:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833248.691204:0:14415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833248.691207:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.691209:0:14415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788833248.691211:0:14415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833248.691214:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.691215:0:14415:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788833248.691219:0:14415:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cea3f68e000 00000020:00000080:2.0:1788833248.691221:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788833248.691259:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14415:1875727265913088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833248.691296:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.691331:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f98ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833248.691478:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913088 00000100:00100000:1.0:1788833248.691483:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913088 00000100:00100000:1.0:1788833248.691512:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788833248.691519:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14415:x1875727265913088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833248.691713:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14415:x1875727265913088:12345-0@lo:502:llog_process_th.0 Request processed in 193us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833248.691728:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788833248.694579:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14415:1875727265913088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788833248.694623:0:14415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833248.694632:0:14415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833248.694634:0:14415:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788833248.694638:0:14415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788833248.694815:0:14371:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788833248.694836:0:14371:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788833248.694860:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.694882:0:14371:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833248.694922:0:14371:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788833248.694924:0:14371:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cea3f68e000 10000000:01000000:0.0:1788833248.694927:0:14371:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cea3f68e000 10000000:01000000:0.0:1788833248.694931:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788833248.694936:0:14371:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea3f68e000 from 1 10000000:01000000:0.0:1788833248.694938:0:14371:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788833248.694968:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925ac00/0x8c08e876ed3ffa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.694976:0:14371:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea0925ac00/0x8c08e876ed3ffa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.694986:0:14371:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea0925ac00/0x8c08e876ed3ffa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833248.695003:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788833248.695089:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833248.695124:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea27f8a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.695268:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913216 00000100:00100000:2.0:1788833248.695280:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913216 00000100:00100000:2.0:1788833248.695324:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788833248.695332:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14371:x1875727265913216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833248.695344:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833248.695356:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea1f036600/0x8c08e876ed3ffa8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffa87 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.695377:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f036600/0x8c08e876ed3ffa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa87 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.695386:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea1f036600/0x8c08e876ed3ffa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa87 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.695394:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036600, rc 0) 00000100:00100000:2.0:1788833248.695428:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14371:x1875727265913216:12345-0@lo:101:mount.lustre.0 Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.695434:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788833248.695547:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833248.695559:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea0925ac00/0x8c08e876ed3ffa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa8e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.695568:0:14371:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea0925ac00/0x8c08e876ed3ffa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffa8e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833248.695625:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833248.695651:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833248.695678:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea27f8a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788833248.695732:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913344 00000100:00100000:1.0:1788833248.695736:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913344 00000100:00100000:1.0:1788833248.695766:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788833248.695773:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14371:x1875727265913344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833248.696000:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14371:x1875727265913344:12345-0@lo:501:mount.lustre.0 Request processed in 227us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833248.696008:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788833248.698730:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833248.698789:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833248.698854:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833248.698901:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea27f8a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.701580:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913472 00000100:00100000:2.0:1788833248.701593:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913472 00000100:00100000:2.0:1788833248.701648:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788833248.701658:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14371:x1875727265913472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788833248.701891:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14371:x1875727265913472:12345-0@lo:503:mount.lustre.0 Request processed in 234us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.701899:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788833248.705260:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833248.706433:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14419:1875727265913600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833248.706512:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833248.706557:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea0890f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.706610:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913600 00000100:00100000:2.0:1788833248.706616:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913600 00000100:00100000:2.0:1788833248.706662:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788833248.706671:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14419:x1875727265913600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833248.706909:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14419:x1875727265913600:12345-0@lo:502:llog_process_th.0 Request processed in 239us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.706916:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788833248.707488:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14419:1875727265913600:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788833248.707551:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788833248.707576:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cea41ca19b8) 00000020:00000080:1.0:1788833248.707598:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788833248.707685:0:14419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea3f68e000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788833248.707690:0:14419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea3f68e000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788833248.707692:0:14419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea3f68e000 4 00010000:00080000:1.0:1788833248.707718:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea4096e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1788833248.713567:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788833248.713773:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788833248.713810:0:14419:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788833248.713823:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8c08e876ed3ffa9c 00000100:00080000:1.0:1788833248.713834:0:14419:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788833248.713840:0:14419:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cea4096e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1788833248.713878:0:14419:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea05ca8380 x1875727265913728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788833248.713902:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788833248.714110:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265913728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788833248.714186:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833248.716431:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913728 00000100:00100000:1.0:1788833248.717160:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913728 00000100:00100000:1.0:1788833248.717212:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833248.717221:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875727265913728:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788833248.717307:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875727265913728:12345-0@lo:38:llog_process_th.0 Request processed in 85us (3120us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788833248.717316:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833248.717489:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14419:1875727265913856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788833248.717539:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833248.717566:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea0890fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.717793:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788833248.717802:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea4096e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788833248.717806:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788833248.717810:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265913728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788833248.717835:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913856 00000100:00100000:2.0:1788833248.717839:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913856 00000100:00100000:2.0:1788833248.717870:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788833248.717877:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14419:x1875727265913856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788833248.718171:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14419:x1875727265913856:12345-0@lo:502:llog_process_th.0 Request processed in 293us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.718179:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788833248.718341:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14419:1875727265913856:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788833248.718365:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788833248.726167:0:14371:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788833248.726203:0:14371:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788833248.726272:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925ac00/0x8c08e876ed3ffa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa8e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.726285:0:14371:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea0925ac00/0x8c08e876ed3ffa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffa8e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788833248.726337:0:14371:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788833248.726340:0:14371:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788833248.726346:0:14371:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833248.726347:0:14371:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833248.726348:0:14371:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833248.726349:0:14371:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833248.726350:0:14371:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788833248.726352:0:14371:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788833248.726353:0:14371:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833248.726354:0:14371:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788833248.726358:0:14371:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788833248.726361:0:14371:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788833248.726362:0:14371:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788833248.726363:0:14371:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833248.726363:0:14371:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833248.726365:0:14371:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833248.726366:0:14371:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833248.726367:0:14371:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788833248.726368:0:14371:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788833248.726369:0:14371:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833248.726370:0:14371:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788833248.726397:0:14371:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788833248.726417:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788833248.726497:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.726543:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea3f98c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833248.728263:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265913984 00000100:00100000:0.0:1788833248.728277:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265913984 00000100:00100000:0.0:1788833248.728332:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788833248.728342:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14371:x1875727265913984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788833248.728374:0:14382:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788833248.728387:0:14382:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788833248.783466:0:14382:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788833248.783485:0:14382:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788833248.783874:0:14405:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788833248.783879:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788833248.783902:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.783920:0:14405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.783928:0:14405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.783966:0:14405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.784010:0:14405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 12 pid: 14383 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833248.784023:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14405:1875727265914112:0@lo:104: 00000100:00100000:1.0:1788833248.784110:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833248.784156:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea0890fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833248.784313:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265914112 00000100:00100000:2.0:1788833248.784320:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265914112 00000100:00100000:2.0:1788833248.784360:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833248.784370:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14405:x1875727265914112:12345-0@lo:104: 00010000:00010000:2.0:1788833248.784380:0:14372:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.784431:0:14372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833248.784437:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14405:x1875727265914112:12345-0@lo:104: Request processed in 69us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.784452:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788833248.784476:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833248.784482:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.784490:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037e00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833248.784494:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.784502:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833248.784509:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833248.784515:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833248.784543:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.784550:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833248.784569:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.784575:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea1f037e00/0x8c08e876ed3ffa6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffa72 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.784589:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833248.784591:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833248.784592:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833248.784824:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3279:1875727265914240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833248.784863:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833248.785075:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14405:1875727265914112:0@lo:104: 00010000:00010000:2.0:1788833248.785092:0:14405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833248.786997:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265914240 00000100:00100000:0.0:1788833248.787011:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265914240 00010000:00010000:0.0:1788833248.787062:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 13 pid: 14383 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833248.787102:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788833248.787110:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+13:3279:x1875727265914240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788833248.787122:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833248.787127:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 13 pid: 14383 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.787138:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 13 pid: 14383 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.787254:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffa72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3ffa6b expref: 13 pid: 14383 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.787272:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833248.787281:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788833248.790510:0:14374:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006629962s 00010000:00010000:1.0:1788833248.790523:0:14374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.790535:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.790543:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.790550:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.790556:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833248.790560:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.790567:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.790585:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833248.790595:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833248.790687:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:3279:x1875727265914240:12345-0@lo:103:ldlm_bl.0 Request processed in 3575us (5821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833248.790701:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833248.790792:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3279:1875727265914240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833248.790824:0:14405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.790835:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833248.790842:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea02fac800/0x8c08e876ed3ffaa3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833248.798777:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14371:x1875727265913984:12345-0@lo:253:mount.lustre.0 Request processed in 70427us (72270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833248.798792:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788833248.799054:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14371:1875727265913984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788833248.799070:0:14371:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788833248.799073:0:14371:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788833248.799075:0:14371:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788833248.799076:0:14371:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833248.799077:0:14371:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833248.799078:0:14371:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833248.799080:0:14371:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833248.799081:0:14371:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788833248.799082:0:14371:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788833248.799084:0:14371:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833248.799085:0:14371:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788833248.799099:0:14371:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788833248.810834:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788833248.811011:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788833248.811346:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788833248.811506:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788833248.811777:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788833248.811934:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833248.812924:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833248.813154:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833248.813430:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833248.813671:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833248.813938:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833248.814139:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788833248.873432:0:14371:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788833248.874921:0:14371:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788833248.875177:0:14427:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788833248.875182:0:14427:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788833248.875452:0:14428:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788833248.875560:0:14428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788833248.876951:0:14371:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788833248.877134:0:14371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788833248.877972:0:14371:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788833248.877983:0:14371:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788833248.878099:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1788833248.878164:0:14371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788833248.878171:0:14428:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788833248.878175:0:14428:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788833248.879748:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788833248.880886:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788833248.880932:0:14371:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788833248.882937:0:14371:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788833248.889330:0:14371:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788833249.007922:0:14371:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788833249.007958:0:14371:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb42c01c87988 00100000:10000000:2.0:1788833249.007966:0:14371:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788833249.009599:0:14371:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788833249.009733:0:14371:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788833249.009752:0:14371:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788833249.009777:0:14371:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788833249.453265:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833249.786942:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788833249.838097:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788833249.838116:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea3f68e000 from 6 10000000:01000000:2.0:1788833249.838121:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788833249.838172:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833249.838183:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833249.838194:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833249.838218:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265914368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788833249.838280:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833249.838328:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea0890f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788833249.838437:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265914368 00000100:00100000:3.0:1788833249.838444:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265914368 00000100:00100000:3.0:1788833249.838487:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788833249.838495:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14385:x1875727265914368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833249.838506:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833249.838518:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffaaa expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833249.838539:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833249.838548:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833249.838556:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516000, rc 0) 00000100:00100000:3.0:1788833249.839574:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265914368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1073us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833249.839583:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788833249.842516:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265914368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833249.842542:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833249.842554:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833249.842625:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265914496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788833249.842685:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833249.842774:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54180 going to sleep for 11 seconds 00000100:00100000:2.0:1788833249.844617:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265914496 00000100:00100000:2.0:1788833249.844629:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265914496 00000100:00100000:2.0:1788833249.844769:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788833249.844779:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265914496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788833249.844805:0:14382:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788833249.844822:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788833249.844825:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788833249.845158:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265914496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 380us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833249.845166:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788833249.845258:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265914496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788833249.845308:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788833249.845318:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833249.845328:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833250.477372:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788833250.800869:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788833251.504735:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833252.525303:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788833253.471214:0:14671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788833253.549552:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788833253.997873:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833253.997880:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788833253.997883:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833253.997897:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788833253.997900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788833253.997903:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788833253.997907:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cea4096e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788833253.997917:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cea4096e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1788833253.997939:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea05cabb80 x1875727265914752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788833253.997972:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265914752:0@lo:38:kworker.0 00000100:00100000:1.0:1788833253.998059:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833253.998149:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265914752 00000100:00100000:1.0:1788833253.998157:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265914752 00000100:00100000:1.0:1788833253.998187:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833253.998193:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3275:x1875727265914752:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788833253.998216:0:14391:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:1.0:1788833253.998253:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8c08e876ed3ffab8 00000004:00100000:1.0:1788833253.998268:0:14391:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788833253.998599:0:14391:0:(import.c:65:import_set_state_nolock()) ffff9cea06624000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833253.998661:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875727265914752:12345-0@lo:38:kworker.0 Request processed in 465us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833253.998669:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788833253.998767:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cea05cabb80 x1875727265914752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788833253.998781:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788833253.998797:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788833253.998801:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788833253.998803:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea4096e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788833253.998809:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875727265914752:0@lo:38:kworker.0 00000100:00100000:3.0:1788833253.998966:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788833253.998980:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3277:1875727265914624:0@lo:400:kworker.0 00000100:00100000:3.0:1788833253.999019:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833254.002458:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265914624 00000100:00100000:2.0:1788833254.002474:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265914624 00000100:00100000:2.0:1788833254.002537:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788833254.002547:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:3277:x1875727265914624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833254.002633:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:3277:x1875727265914624:12345-0@lo:400:kworker.0 Request processed in 88us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833254.002642:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788833254.003136:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3277:1875727265914624:0@lo:400:kworker.0 00010000:00010000:2.0:1788833254.573274:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833255.597146:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788833256.371187:0:14821:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb6001180 20000000:00000080:3.0:1788833256.371207:0:14821:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cea41c7b400 uarg=0000000000000000 20000000:01000000:3.0:1788833256.371247:0:14821:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788833256.371255:0:14821:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788833256.371260:0:14821:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788833256.372264:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788833256.372439:0:14821:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788833256.380870:0:14821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788833256.380902:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833256.380922:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833256.380931:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833256.381297:0:14821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833256.381314:0:14821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 11 pid: 14382 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833256.381328:0:14821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875727265914880:0@lo:104: 00000100:00100000:3.0:1788833256.381388:0:14821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833256.381441:0:14821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788833256.381511:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265914880 00000100:00100000:2.0:1788833256.381520:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265914880 00000100:00100000:2.0:1788833256.381580:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833256.381590:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14821:x1875727265914880:12345-0@lo:104: 00010000:00010000:2.0:1788833256.381602:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.381666:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833256.381672:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14821:x1875727265914880:12345-0@lo:104: Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833256.381679:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788833256.381701:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833256.381708:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.381715:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517200 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833256.381731:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.381739:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833256.381746:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833256.381753:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833256.381778:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.381784:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833256.381803:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.381810:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea01517200/0x8c08e876ed3ffa79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffa80 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.381825:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833256.381827:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833256.381829:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833256.381839:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3277:1875727265915008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833256.381867:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833256.381913:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265915008 00000100:00100000:2.0:1788833256.381917:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265915008 00010000:00010000:2.0:1788833256.381932:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 12 pid: 14382 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833256.381965:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833256.381982:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:3277:x1875727265915008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833256.381993:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833256.381997:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 12 pid: 14382 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382008:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 12 pid: 14382 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382057:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382065:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382078:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382084:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382090:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382096:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382101:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516c00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833256.382116:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382123:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382136:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833256.382145:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833256.382172:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:3277:x1875727265915008:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833256.382178:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833256.382205:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3277:1875727265915008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788833256.382292:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffa80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3ffa79 expref: 11 pid: 14382 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833256.382302:0:14821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875727265914880:0@lo:104: 00010000:00010000:3.0:1788833256.382314:0:14821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833256.382321:0:14821:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833256.382335:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833256.382341:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffabf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833256.621333:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833257.648271:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788833258.095267:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788833258.095275:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea3f68e000 from 10 10000000:01000000:1.0:1788833258.095280:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788833258.095326:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833258.095369:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833258.095381:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833258.095417:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265915136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788833258.095484:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833258.098696:0:3275:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833248/real 1788833248] req@ffff9cea05ca8700 x1875727265912064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833258 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833258.098743:0:3275:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cea05ca8700 x1875727265912064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833258 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833258.098753:0:3275:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833248/real 1788833248] req@ffff9cea40eadf80 x1875727265911936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833258 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833258.098765:0:3275:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cea40eadf80 x1875727265911936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833258 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788833258.098782:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788833258.098796:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788833258.098800:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265912064:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788833258.098805:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ce9020d5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788833258.098809:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788833258.098811:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265911936:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788833258.098882:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788833258.098887:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788833258.098890:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ce9020d5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788833258.098895:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 382 00000100:00080000:2.0:1788833258.098900:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788833258.098905:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce9020d5800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833258.098934:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40eae300 x1875727265915264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788833258.098981:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265915264:0@lo:8:kworker.0 00000400:00000100:0.0:1788833258.099028:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875727265915264 offset 0 length 520: 4 00000100:00080000:2.0:1788833258.099116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788833258.099119:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788833258.099122:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788833258.099125:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 382 00000100:00080000:2.0:1788833258.099128:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788833258.099132:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cea0350c800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833258.099145:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40eaf800 x1875727265915392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788833258.099199:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265915520:0@lo:400:kworker.0 00000100:00100000:2.0:1788833258.099235:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833258.100827:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265915136 00000100:00100000:3.0:1788833258.100840:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265915136 00000100:00100000:3.0:1788833258.103312:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788833258.103334:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+11:14385:x1875727265915136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833258.103363:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833258.103385:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffac6 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833258.103682:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833258.103695:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833258.103703:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516c00, rc 0) 00000100:00100000:3.0:1788833258.103766:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265915136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 444us (8282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833258.103773:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788833258.107833:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265915392:0@lo:8:kworker.0 00000100:00100000:2.0:1788833258.108481:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265915520 00000100:00100000:2.0:1788833258.108491:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265915520 00000100:00100000:2.0:1788833258.108537:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833258.108546:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265915520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833258.108626:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265915520:12345-0@lo:400:kworker.0 Request processed in 80us (9389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833258.108633:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788833258.108683:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cea40ead180 x1875727265915520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833258.108697:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265915520:0@lo:400:kworker.0 00000400:00000100:1.0:1788833258.108985:0:3275:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875727265915392 offset 0 length 520: 4 00000100:00100000:1.0:1788833258.109024:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54540 going to sleep for 11 seconds 00000100:00100000:1.0:1788833258.109068:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265915136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833258.110269:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833258.110287:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833258.110371:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265915648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833258.110429:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833258.111051:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265915648 00000100:00100000:3.0:1788833258.111059:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265915648 00000100:00100000:3.0:1788833258.111966:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788833258.111980:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265915648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833258.112319:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54540 going to sleep for 11 seconds 00000100:00100000:3.0:1788833258.113964:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265915648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1983us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833258.113976:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788833258.114252:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265915648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833258.114314:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265915776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833258.114376:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833258.114423:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265915776 00000100:00100000:1.0:1788833258.114429:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265915776 00000100:00100000:1.0:1788833258.114463:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788833258.114470:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265915776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833258.114615:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:14385:x1875727265915776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833258.114622:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788833258.114660:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54540 going to sleep for 11 seconds 00000100:00100000:1.0:1788833258.114671:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265915776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788833258.115355:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788833258.115426:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788833258.115447:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788833258.115457:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833258.115467:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833258.669518:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833259.696726:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833260.013728:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788833260.717274:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788833261.307977:0:15070:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788833261.307982:0:15070:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788833261.308149:0:15070:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cea0395f000 00000020:01000004:3.0:1788833261.308163:0:15070:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788833261.308174:0:15070:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788833261.308186:0:15070:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cea06990000) 00000020:00000080:3.0:1788833261.308199:0:15070:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788833261.326421:0:15070:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788833261.326760:0:15070:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788833261.328204:0:15070:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788833261.328426:0:15070:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788833261.328611:0:15070:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788833261.329325:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788833261.329468:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788833261.329595:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788833261.330450:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 178: rc = 0 00100000:10000000:2.0:1788833261.330809:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 178: rc = 0 00100000:10000000:2.0:1788833261.331387:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 178: rc = 0 00100000:10000000:2.0:1788833261.331632:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 178: rc = 0 00100000:10000000:2.0:1788833261.331878:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 178: rc = 0 00100000:10000000:2.0:1788833261.332234:0:15070:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 178: rc = 0 00000020:00000080:2.0:1788833261.332758:0:15070:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788833261.332768:0:15070:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788833261.332777:0:15070:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c08e876ed3ffadb 00000020:01000004:2.0:1788833261.332784:0:15070:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788833261.332804:0:15070:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788833261.332808:0:15070:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788833261.332813:0:15070:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788833261.332818:0:15070:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788833261.332828:0:15070:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cea1f788000) 00000020:00000080:2.0:1788833261.332838:0:15070:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788833261.337376:0:15070:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833261.337538:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788833261.337543:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788833261.347371:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788833261.347386:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788833261.347731:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788833261.347739:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788833261.350616:0:15070:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833261.350833:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788833261.350838:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788833261.356423:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788833261.356440:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788833261.382471:0:15070:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833261.382716:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788833261.382722:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788833261.383863:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788833261.383874:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788833261.384715:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788833261.384722:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788833261.386611:0:15070:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788833261.386812:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788833261.386818:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788833261.387495:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788833261.387503:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788833261.414767:0:15070:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788833261.415323:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788833261.415330:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788833261.416513:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788833261.416524:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788833261.416875:0:15070:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788833261.416902:0:15070:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788833261.416908:0:15070:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788833261.426143:0:15070:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788833261.426188:0:15070:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.155@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788833261.426193:0:15070:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788833261.426194:0:15070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788833261.426195:0:15070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833261.426197:0:15070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833261.426198:0:15070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833261.426199:0:15070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833261.426200:0:15070:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833261.426202:0:15070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833261.426207:0:15070:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788833261.426210:0:15070:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788833261.426212:0:15070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788833261.426213:0:15070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788833261.426214:0:15070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833261.426214:0:15070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833261.426215:0:15070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833261.426216:0:15070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833261.426217:0:15070:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833261.426218:0:15070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833261.426219:0:15070:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788833261.426241:0:15070:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788833261.426259:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265915904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788833261.426323:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833261.426437:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea27f8a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833261.426484:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265915904 00000100:00100000:1.0:1788833261.426492:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265915904 00000100:00100000:1.0:1788833261.426592:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788833261.426603:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:15070:x1875727265915904:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788833261.426629:0:14383:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788833261.426632:0:14383:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788833261.426636:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788833261.431205:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:15070:x1875727265915904:12345-0@lo:253:mount.lustre.0 Request processed in 4596us (4874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.431221:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788833261.431301:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265915904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788833261.431315:0:15070:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788833261.431318:0:15070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788833261.431319:0:15070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788833261.431320:0:15070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788833261.431321:0:15070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788833261.431323:0:15070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788833261.431324:0:15070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788833261.431338:0:15070:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788833261.431339:0:15070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788833261.431341:0:15070:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788833261.431358:0:15070:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cea0395f000 from lustre-OST0000 10000000:01000000:0.0:1788833261.431394:0:15070:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788833261.431396:0:15070:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788833261.431402:0:15070:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cea3f713370 local copy 00010000:00010000:0.0:1788833261.431412:0:15070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833261.431616:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833261.431652:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833261.431729:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088ef3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.431773:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916032 00000100:00100000:3.0:1788833261.431779:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916032 00000100:00100000:3.0:1788833261.431857:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788833261.431866:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:15070:x1875727265916032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833261.432069:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:15070:x1875727265916032:12345-0@lo:501:mount.lustre.0 Request processed in 203us (415us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788833261.432088:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788833261.432246:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916032:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788833261.432260:0:15070:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788833261.432384:0:15070:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788833261.432391:0:15070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.432400:0:15070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833261.432419:0:15070:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cea0395f000 10000000:01000000:0.0:1788833261.432422:0:15070:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788833261.432427:0:15070:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cea3f713370 10000000:01000000:0.0:1788833261.432429:0:15070:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788833261.432432:0:15070:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cea3f713370 from 1 10000000:01000000:0.0:1788833261.432435:0:15070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788833261.432457:0:15070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925bc00/0x8c08e876ed3ffae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.432474:0:15070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea0925bc00/0x8c08e876ed3ffae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.432484:0:15070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea0925bc00/0x8c08e876ed3ffae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833261.432497:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788833261.432524:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833261.432628:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833261.432690:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916160 00000100:00100000:2.0:1788833261.432695:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916160 00000100:00100000:2.0:1788833261.432716:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788833261.432722:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+12:15070:x1875727265916160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833261.432730:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833261.432742:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea1f036a00/0x8c08e876ed3ffaf0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffae9 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833261.432763:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f036a00/0x8c08e876ed3ffaf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffae9 expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833261.432772:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea1f036a00/0x8c08e876ed3ffaf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffae9 expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833261.432780:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036a00, rc 0) 00000100:00100000:2.0:1788833261.432816:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+13:15070:x1875727265916160:12345-0@lo:101:mount.lustre.0 Request processed in 94us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833261.432822:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788833261.432887:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833261.432898:0:15070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea0925bc00/0x8c08e876ed3ffae9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffaf0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.432906:0:15070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea0925bc00/0x8c08e876ed3ffae9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffaf0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833261.432931:0:15070:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788833261.432945:0:15070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925bc00/0x8c08e876ed3ffae9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffaf0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.432953:0:15070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea0925bc00/0x8c08e876ed3ffae9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffaf0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833261.432958:0:15070:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788833261.432962:0:15070:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788833261.432965:0:15070:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788833261.432967:0:15070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788833261.432986:0:15070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925b800/0x8c08e876ed3ffaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.432993:0:15070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea0925b800/0x8c08e876ed3ffaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.433000:0:15070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea0925b800/0x8c08e876ed3ffaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833261.433011:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788833261.433050:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833261.433061:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833261.433178:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916288 00000100:00100000:2.0:1788833261.433182:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916288 00000100:00100000:2.0:1788833261.433200:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788833261.433206:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+13:15070:x1875727265916288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833261.433212:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833261.433219:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea1f036e00/0x8c08e876ed3ffafe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffaf7 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833261.433231:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f036e00/0x8c08e876ed3ffafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffaf7 expref: 14 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833261.433238:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea1f036e00/0x8c08e876ed3ffafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffaf7 expref: 14 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833261.433250:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036e00, rc 0) 00000100:00100000:2.0:1788833261.433284:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916288:12345-0@lo:101:mount.lustre.0 Request processed in 79us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833261.433290:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788833261.433360:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833261.433369:0:15070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea0925b800/0x8c08e876ed3ffaf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffafe expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.433376:0:15070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea0925b800/0x8c08e876ed3ffaf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffafe expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833261.434341:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788833261.435307:0:15070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833261.435563:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788833261.435608:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788833261.435645:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788833261.435698:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788833261.435736:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788833261.435772:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788833261.435837:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788833261.435846:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788833261.436172:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833261.436234:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.436326:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54540 going to sleep for 11 seconds 00000100:00100000:2.0:1788833261.436366:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916416 00000100:00100000:2.0:1788833261.436373:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916416 00000100:00100000:2.0:1788833261.436467:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788833261.436478:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833261.436804:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916416:12345-0@lo:501:mount.lustre.0 Request processed in 327us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833261.436813:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788833261.436880:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833261.436913:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833261.436964:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.437169:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54540 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.437237:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916544 00000100:00100000:3.0:1788833261.437243:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916544 00000100:00100000:3.0:1788833261.437268:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788833261.437275:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788833261.437601:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916544:12345-0@lo:503:mount.lustre.0 Request processed in 325us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.437618:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788833261.437707:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788833261.438531:0:15070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788833261.438599:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833261.438651:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.438719:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54540 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.438753:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916672 00000100:00100000:3.0:1788833261.438760:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916672 00000100:00100000:3.0:1788833261.438833:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788833261.438842:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833261.439176:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916672:12345-0@lo:502:mount.lustre.0 Request processed in 334us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.439183:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788833261.439267:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833261.439493:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788833261.439542:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788833261.439576:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788833261.439623:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788833261.439658:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788833261.439691:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788833261.439755:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788833261.439792:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788833261.439826:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788833261.439878:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788833261.439910:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788833261.439969:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788833261.439999:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833261.440071:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.440436:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54540 going to sleep for 11 seconds 00000100:00100000:2.0:1788833261.440492:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916800 00000100:00100000:2.0:1788833261.440499:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916800 00000100:00100000:2.0:1788833261.440531:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788833261.440539:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833261.440717:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916800:12345-0@lo:502:mount.lustre.0 Request processed in 178us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833261.440724:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788833261.440814:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833261.440889:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788833261.440900:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788833261.441872:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788833261.441881:0:15084:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788833261.441888:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833261.441890:0:15084:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788833261.441895:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788833261.441909:0:15084:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cea41ca3370) 00000020:00000080:1.0:1788833261.441944:0:15084:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788833261.441950:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788833261.442026:0:15084:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea0395f000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788833261.442053:0:15084:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788833261.442060:0:15084:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c08e876ed3ffb0c 00010000:00010000:1.0:1788833261.446678:0:15084:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788833261.447566:0:15084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788833261.449408:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788833261.450804:0:15084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788833261.450815:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833261.450822:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833261.450824:0:15084:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788833261.450828:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788833261.450836:0:15084:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788833261.450838:0:15084:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788833261.450839:0:15084:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788833261.450841:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788833261.450844:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833261.450845:0:15084:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788833261.450848:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833261.450851:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833261.450853:0:15084:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788833261.450856:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788833261.450857:0:15084:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788833261.450860:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833261.450862:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833261.450863:0:15084:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788833261.450866:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833261.450868:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833261.450870:0:15084:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788833261.450873:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788833261.452123:0:15084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833261.452132:0:15084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833261.452134:0:15084:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788833261.452140:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788833261.453051:0:15070:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788833261.453094:0:15070:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788833261.453116:0:15070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925b800/0x8c08e876ed3ffaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffafe expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.453129:0:15070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea0925b800/0x8c08e876ed3ffaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffafe expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833261.453136:0:15070:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea0395f000 from 1 10000000:01000000:0.0:1788833261.453139:0:15070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788833261.453174:0:15070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.453188:0:15070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.453198:0:15070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833261.453219:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788833261.453281:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833261.453317:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088ef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833261.454060:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265916928 00000100:00100000:0.0:1788833261.454067:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265916928 00000100:00100000:0.0:1788833261.454120:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788833261.454131:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+14:15070:x1875727265916928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833261.454143:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833261.454156:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffb13 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.454179:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 15 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.454189:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 15 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.454198:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925ba00, rc 0) 00000100:00100000:0.0:1788833261.454242:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265916928:12345-0@lo:101:mount.lustre.0 Request processed in 113us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833261.454248:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788833261.454303:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265916928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833261.454316:0:15070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833261.454325:0:15070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833261.454786:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788833261.455485:0:15070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788833261.455748:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788833261.455793:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788833261.455861:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788833261.455870:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788833261.457113:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833261.457177:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833261.457216:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917056 00000100:00100000:0.0:1788833261.457222:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917056 00000100:00100000:0.0:1788833261.457256:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788833261.457262:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833261.457456:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917056:12345-0@lo:501:mount.lustre.0 Request processed in 192us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833261.457463:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788833261.457502:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f179f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833261.457519:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833261.457548:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833261.457586:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833261.457610:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f179f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.458121:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917184 00000100:00100000:3.0:1788833261.458129:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917184 00000100:00100000:3.0:1788833261.458158:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788833261.458164:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788833261.458332:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917184:12345-0@lo:503:mount.lustre.0 Request processed in 166us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.458338:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788833261.459099:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917184:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788833261.459575:0:15070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788833261.460804:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833261.460872:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833261.461053:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea2f309780 going to sleep for 11 seconds 00000100:00100000:2.0:1788833261.465339:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917312 00000100:00100000:2.0:1788833261.465355:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917312 00000100:00100000:2.0:1788833261.465462:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788833261.465476:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833261.465743:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917312:12345-0@lo:502:mount.lustre.0 Request processed in 269us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833261.465750:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788833261.465841:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833261.466141:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788833261.466190:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788833261.466246:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788833261.466276:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788833261.466299:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788833261.466336:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788833261.466365:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788833261.466394:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788833261.466430:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833261.466477:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.470093:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54000 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.471831:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917440 00000100:00100000:3.0:1788833261.471843:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917440 00000100:00100000:3.0:1788833261.471907:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788833261.471916:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833261.472223:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917440:12345-0@lo:502:mount.lustre.0 Request processed in 307us (5744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.472231:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788833261.472420:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833261.472564:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788833261.472578:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788833261.473503:0:15088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833261.473513:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833261.473515:0:15088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788833261.473522:0:15088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea0395f000 00000020:00000080:2.0:1788833261.473525:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833261.473531:0:15088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833261.473534:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833261.473536:0:15088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788833261.473538:0:15088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833261.473540:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833261.473542:0:15088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788833261.473545:0:15088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cea0395f000 00000020:00000080:2.0:1788833261.473547:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833261.473616:0:15088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833261.473621:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833261.473622:0:15088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788833261.473625:0:15088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833261.473627:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833261.473629:0:15088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788833261.473632:0:15088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cea0395f000 00000020:00000080:2.0:1788833261.473634:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833261.473673:0:15088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833261.473677:0:15088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833261.473678:0:15088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788833261.473681:0:15088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788833261.473809:0:15070:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788833261.473830:0:15070:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788833261.473849:0:15070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.473859:0:15070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833261.473897:0:15070:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788833261.473899:0:15070:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cea0395f000 10000000:01000000:1.0:1788833261.473902:0:15070:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cea0395f000 10000000:01000000:1.0:1788833261.473906:0:15070:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788833261.473911:0:15070:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cea0395f000 from 1 10000000:01000000:1.0:1788833261.473914:0:15070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788833261.473953:0:15070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea02fac000/0x8c08e876ed3ffb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.473962:0:15070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea02fac000/0x8c08e876ed3ffb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.473971:0:15070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea02fac000/0x8c08e876ed3ffb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833261.473992:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788833261.474089:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.474122:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.474275:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917568 00000100:00100000:3.0:1788833261.474282:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917568 00000100:00100000:3.0:1788833261.474325:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788833261.474334:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265917568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833261.474352:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833261.474364:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517200/0x8c08e876ed3ffb28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffb21 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.474385:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517200/0x8c08e876ed3ffb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb21 expref: 16 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.474395:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517200/0x8c08e876ed3ffb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb21 expref: 16 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.474402:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517200, rc 0) 00000100:00100000:3.0:1788833261.474438:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265917568:12345-0@lo:101:mount.lustre.0 Request processed in 104us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.474443:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788833261.477261:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788833261.477286:0:15070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea02fac000/0x8c08e876ed3ffb21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb28 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.477298:0:15070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea02fac000/0x8c08e876ed3ffb21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffb28 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833261.477872:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788833261.480448:0:15070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833261.480760:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788833261.480807:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788833261.480841:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788833261.480888:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788833261.482168:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788833261.482277:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788833261.482317:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788833261.482351:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788833261.482399:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788833261.482435:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788833261.482471:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788833261.482518:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788833261.482552:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788833261.482587:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788833261.482635:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788833261.482675:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788833261.482711:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788833261.482761:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788833261.482797:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788833261.482829:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788833261.482879:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788833261.486161:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788833261.486247:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788833261.486337:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788833261.486378:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788833261.486416:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788833261.486468:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788833261.486508:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788833261.486599:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788833261.486608:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788833261.486725:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833261.486793:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.486836:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.487005:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917696 00000100:00100000:3.0:1788833261.487013:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917696 00000100:00100000:3.0:1788833261.487112:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788833261.487121:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265917696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833261.487339:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265917696:12345-0@lo:501:mount.lustre.0 Request processed in 219us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.487347:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788833261.488106:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833261.488151:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833261.488200:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.488229:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917824 00000100:00100000:1.0:1788833261.488234:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917824 00000100:00100000:1.0:1788833261.488269:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788833261.488276:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265917824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833261.488424:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265917824:12345-0@lo:503:mount.lustre.0 Request processed in 147us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833261.488432:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788833261.488475:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833261.488487:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788833261.490132:0:15070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788833261.490212:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833261.490274:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.490307:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265917952 00000100:00100000:1.0:1788833261.490319:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265917952 00000100:00100000:1.0:1788833261.490354:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788833261.490363:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265917952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833261.490568:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265917952:12345-0@lo:502:mount.lustre.0 Request processed in 205us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833261.490575:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788833261.490623:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833261.490641:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265917952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833261.490890:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788833261.492319:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788833261.492385:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788833261.492449:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788833261.492487:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788833261.492555:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788833261.492593:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788833261.492623:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788833261.492671:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788833261.492704:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788833261.492737:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788833261.492797:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788833261.492833:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788833261.492864:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788833261.492907:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788833261.493248:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788833261.493285:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788833261.493336:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788833261.496127:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788833261.496213:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788833261.496301:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788833261.496353:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788833261.496400:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788833261.496463:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788833261.496502:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788833261.496537:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788833261.496578:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788833261.496610:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788833261.496639:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788833261.496681:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788833261.496713:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788833261.496746:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788833261.496775:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788833261.496819:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788833261.496857:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788833261.496904:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788833261.499150:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788833261.499232:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788833261.499306:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788833261.499344:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788833261.499394:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265918080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833261.499470:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.499518:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833261.499745:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918080 00000100:00100000:2.0:1788833261.499753:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918080 00000100:00100000:2.0:1788833261.499801:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788833261.499811:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265918080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833261.500053:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265918080:12345-0@lo:502:mount.lustre.0 Request processed in 243us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833261.500061:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788833261.500268:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265918080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833261.500350:0:15070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788833261.500361:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788833261.508491:0:15093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788833261.508509:0:15093:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cea41ca0000) 00000020:00000080:1.0:1788833261.508531:0:15093:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788833261.508617:0:15093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cea0395f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788833261.508622:0:15093:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cea0395f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788833261.508625:0:15093:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cea0395f000 3 00010000:00080000:1.0:1788833261.508661:0:15093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cea052d2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1788833261.510351:0:15093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788833261.512295:0:15093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788833261.512335:0:15093:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788833261.512348:0:15093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8c08e876ed3ffb36 00000100:00080000:0.0:1788833261.512358:0:15093:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788833261.512363:0:15093:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cea052d2000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1788833261.512394:0:15093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce902701880 x1875727265918208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788833261.512420:0:15093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788833261.512865:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1788833261.513136:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875727265918208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788833261.513201:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.513253:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918208 00000100:00100000:1.0:1788833261.513260:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918208 00000100:00100000:1.0:1788833261.513287:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833261.513293:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875727265918208:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788833261.513314:0:14389:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:1.0:1788833261.513347:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8c08e876ed3ffb3d 00000004:00100000:1.0:1788833261.513360:0:14389:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788833261.513389:0:14389:0:(import.c:65:import_set_state_nolock()) ffff9cea3f6f3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833261.513437:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875727265918208:12345-0@lo:38:llog_process_th.0 Request processed in 142us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833261.513444:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788833261.513480:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce902701880 x1875727265918208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833261.513490:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788833261.513497:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788833261.513504:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788833261.513508:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788833261.513510:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea052d2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788833261.513515:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875727265918208:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788833261.514863:0:15070:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788833261.514909:0:15070:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:3.0:1788833261.516668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788833261.516676:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788833261.516679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788833261.516682:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788833261.516804:0:15070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea02fac000/0x8c08e876ed3ffb21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb28 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.516826:0:15070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea02fac000/0x8c08e876ed3ffb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb28 expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833261.516883:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265918336:0@lo:400:kworker.0 00000100:00100000:3.0:1788833261.516954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833261.517006:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918336 00000100:00100000:3.0:1788833261.517013:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918336 00000020:01000004:1.0:1788833261.517027:0:15070:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788833261.517049:0:15070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788833261.517051:0:15070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788833261.517052:0:15070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788833261.517053:0:15070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788833261.517055:0:15070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788833261.517056:0:15070:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788833261.517058:0:15070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788833261.517059:0:15070:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788833261.517062:0:15070:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000100:00100000:3.0:1788833261.517065:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1788833261.517065:0:15070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788833261.517066:0:15070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788833261.517067:0:15070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788833261.517069:0:15070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788833261.517070:0:15070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788833261.517071:0:15070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788833261.517072:0:15070:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:3.0:1788833261.517073:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265918336:12345-0@lo:400:kworker.0 00000020:01000004:1.0:1788833261.517073:0:15070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788833261.517074:0:15070:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788833261.517113:0:15070:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788833261.517125:0:15070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265918464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788833261.517159:0:15070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.517181:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918464 00000100:00100000:1.0:1788833261.517185:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918464 00000100:00100000:1.0:1788833261.517214:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788833261.517221:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15070:x1875727265918464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788833261.517241:0:14383:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788833261.517252:0:14383:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788833261.517894:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265918336:12345-0@lo:400:kworker.0 Request processed in 818us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.517904:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788833261.517951:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cea3fb7f800 x1875727265918336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833261.517965:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265918336:0@lo:400:kworker.0 00000100:00100000:0.0:1788833261.526539:0:15070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c54000 going to sleep for 11 seconds 20000000:01000000:3.0:1788833261.548275:0:14383:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788833261.548298:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788833261.548343:0:14405:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788833261.548348:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788833261.548382:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.548400:0:14405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.548409:0:14405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.548458:0:14405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833261.548474:0:14405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 16 pid: 14383 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833261.548487:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14405:1875727265918592:0@lo:104: 00000100:00100000:1.0:1788833261.548556:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833261.548633:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1f6476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833261.550324:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918592 00000100:00100000:3.0:1788833261.550337:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918592 00000100:00100000:3.0:1788833261.550390:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833261.550400:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14405:x1875727265918592:12345-0@lo:104: 00010000:00010000:3.0:1788833261.550418:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550516:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788833261.550524:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14405:x1875727265918592:12345-0@lo:104: Request processed in 126us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.550533:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788833261.550559:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833261.550565:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550589:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037000 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:3.0:1788833261.550593:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550601:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788833261.550608:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833261.550614:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788833261.550652:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550659:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788833261.550680:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550687:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea1f037000/0x8c08e876ed3ffaaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffab1 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550704:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833261.550706:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833261.550707:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833261.550735:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265918720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788833261.550772:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833261.550828:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918720 00000100:00100000:3.0:1788833261.550832:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918720 00010000:00010000:3.0:1788833261.550851:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 17 pid: 14383 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833261.550883:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833261.550890:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:3276:x1875727265918720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788833261.550901:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833261.550906:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 17 pid: 14383 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550916:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 17 pid: 14383 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550944:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550952:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788833261.550967:0:14376:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006629962s 00010000:00010000:3.0:1788833261.550971:0:14376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550977:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550983:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550989:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.550993:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833261.551003:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.551011:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.551021:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.551050:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833261.551092:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:3276:x1875727265918720:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833261.551099:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833261.551133:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265918720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788833261.551162:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516000/0x8c08e876ed3ffab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3ffaaa expref: 16 pid: 14383 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833261.551172:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14405:1875727265918592:0@lo:104: 00010000:00010000:3.0:1788833261.551186:0:14405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.551192:0:14405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.551198:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833261.551203:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea02fad200/0x8c08e876ed3ffb44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833261.557982:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:15070:x1875727265918464:12345-0@lo:253:mount.lustre.0 Request processed in 40753us (40813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833261.557995:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788833261.558144:0:15070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15070:1875727265918464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788833261.558158:0:15070:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788833261.558161:0:15070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788833261.558162:0:15070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788833261.558164:0:15070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833261.558165:0:15070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833261.558166:0:15070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833261.558167:0:15070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833261.558169:0:15070:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833261.558170:0:15070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833261.558172:0:15070:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788833261.558189:0:15070:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788833261.563408:0:15070:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788833261.563654:0:15070:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788833261.563807:0:15070:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788833261.564068:0:15070:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788833261.564229:0:15070:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788833261.564436:0:15070:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788833261.565715:0:15070:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788833261.616201:0:15070:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788833261.616211:0:15070:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788833261.616247:0:15070:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788833261.616306:0:15070:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788833261.616328:0:15070:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788833261.616358:0:15070:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788833261.745398:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833262.766857:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788833263.342523:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788833263.342530:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea3f68e000 from 7 10000000:01000000:0.0:1788833263.342535:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788833263.342594:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833263.342606:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833263.342619:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833263.342648:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265918848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833263.342728:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833263.342779:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea15002000 going to sleep for 11 seconds 00000100:00100000:0.0:1788833263.345934:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918848 00000100:00100000:0.0:1788833263.345948:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918848 00000100:00100000:0.0:1788833263.346007:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788833263.346016:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+15:14385:x1875727265918848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833263.346052:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833263.346084:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffb4b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833263.346113:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 16 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833263.346125:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 16 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833263.346134:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a600, rc 0) 00000100:00100000:0.0:1788833263.346213:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:14385:x1875727265918848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833263.346220:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788833263.346277:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265918848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833263.346294:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833263.346303:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833263.346376:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265918976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788833263.346421:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833263.346457:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea15002000 going to sleep for 11 seconds 00000100:00100000:2.0:1788833263.346955:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265918976 00000100:00100000:2.0:1788833263.346961:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265918976 00000100:00100000:2.0:1788833263.347002:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788833263.347010:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:14385:x1875727265918976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788833263.347045:0:14382:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788833263.347066:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788833263.347077:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788833263.347174:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:14385:x1875727265918976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833263.347185:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788833263.347973:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265918976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788833263.348781:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788833263.348792:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833263.348804:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833263.790199:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833264.813210:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833265.837265:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788833266.797476:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833266.797554:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788833266.797557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833266.797560:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788833266.797604:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833266.797635:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265919104:0@lo:400:kworker.0 00000100:00100000:0.0:1788833266.797834:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833266.797904:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265919232:0@lo:400:kworker.0 00000100:00100000:0.0:1788833266.797937:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833266.797959:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788833266.797964:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265919360:0@lo:400:kworker.0 00000100:00100000:0.0:1788833266.797999:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833266.798058:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265919104 00000100:00100000:0.0:1788833266.798066:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265919104 00000100:00100000:0.0:1788833266.798111:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788833266.798119:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3276:x1875727265919104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833266.798165:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3276:x1875727265919104:12345-0@lo:400:kworker.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833266.798173:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788833266.798208:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265919232 00000100:00100000:0.0:1788833266.798211:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265919232 00000100:00100000:0.0:1788833266.798232:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265919360 00000100:00100000:0.0:1788833266.798235:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265919360 00000100:00100000:0.0:1788833266.798263:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833266.798284:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265919232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833266.798321:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265919232:12345-0@lo:400:kworker.0 Request processed in 38us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833266.798326:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833266.798338:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833266.798343:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265919360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833266.798367:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265919360:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833266.798372:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788833266.798410:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce902700700 x1875727265919360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833266.798423:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265919360:0@lo:400:kworker.0 00010000:00080000:0.0:1788833266.798432:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce902700000 x1875727265919232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833266.798439:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265919232:0@lo:400:kworker.0 00000100:00100000:0.0:1788833266.798464:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265919104:0@lo:400:kworker.0 00000100:00080000:3.0:1788833266.798932:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788833266.861462:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833267.885276:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788833268.070789:0:15439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788833268.910395:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833269.937801:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833270.253687:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788833270.958773:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788833271.917293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833271.917300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788833271.917303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833271.917320:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788833271.917348:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265919488:0@lo:400:kworker.0 00000100:00100000:1.0:1788833271.917363:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265919744:0@lo:400:kworker.0 00000100:00100000:2.0:1788833271.917428:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265919616:0@lo:400:kworker.0 00000100:00100000:1.0:1788833271.919182:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833271.920430:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265919744 00000100:00100000:1.0:1788833271.920441:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265919744 00000100:00100000:1.0:1788833271.920505:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833271.920516:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265919744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833271.920592:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265919744:12345-0@lo:400:kworker.0 Request processed in 79us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833271.920600:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788833271.920621:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788833271.920651:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05ca9c00 x1875727265919744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833271.920664:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265919744:0@lo:400:kworker.0 00000100:00100000:0.0:1788833271.921636:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833271.922049:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265919488 00000100:00100000:1.0:1788833271.922057:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265919488 00000100:00100000:1.0:1788833271.922102:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788833271.922111:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3276:x1875727265919488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833271.922183:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3276:x1875727265919488:12345-0@lo:400:kworker.0 Request processed in 73us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833271.922317:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788833271.922382:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265919488:0@lo:400:kworker.0 00000100:00100000:2.0:1788833271.923412:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833271.923688:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265919616 00000100:00100000:0.0:1788833271.923695:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265919616 00000100:00100000:0.0:1788833271.924769:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788833271.924784:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265919616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833271.924864:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265919616:12345-0@lo:400:kworker.0 Request processed in 84us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833271.924888:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788833271.925331:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05ca8a80 x1875727265919616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833271.925345:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265919616:0@lo:400:kworker.0 00010000:00010000:1.0:1788833271.981320:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.005249:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833273.779952:0:3275:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833258/real 1788833258] req@ffff9cea40eaf800 x1875727265915392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833273 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833273.779999:0:3275:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cea40eaf800 x1875727265915392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833273 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833273.780010:0:3275:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833258/real 1788833258] req@ffff9cea40eae300 x1875727265915264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833273 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833273.780174:0:3275:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cea40eae300 x1875727265915264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833273 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788833273.780197:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788833273.780269:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788833273.780275:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265915392:0@lo:8:kworker.0 00000100:00080000:2.0:1788833273.780282:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ce9020d5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788833273.783883:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833273.783891:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788833273.783896:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce9020d5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788833273.783907:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 392 00000100:00080000:0.0:1788833273.783914:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788833273.783922:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce9020d5800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1788833273.783954:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce902700000 x1875727265920000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788833273.783968:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833273.783971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788833273.783973:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788833273.783976:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 392 00000100:00080000:0.0:1788833273.783979:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788833273.783981:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cea0350c800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1788833273.784005:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce902700700 x1875727265920128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788833273.784102:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3279:1875727265919872:0@lo:400:kworker.0 00000100:00100000:0.0:1788833273.784198:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833273.784279:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265920256:0@lo:400:kworker.0 00000100:00100000:0.0:1788833273.784308:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833273.784329:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833273.784334:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265920384:0@lo:400:kworker.0 00000100:00100000:0.0:1788833273.784352:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833273.784398:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265919872 00000100:00100000:0.0:1788833273.784407:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265919872 00000100:00100000:0.0:1788833273.784456:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788833273.784466:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3279:x1875727265919872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833273.784526:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3279:x1875727265919872:12345-0@lo:400:kworker.0 Request processed in 61us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833273.784534:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788833273.784575:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920256 00000100:00100000:0.0:1788833273.784579:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920256 00000100:00100000:0.0:1788833273.784606:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920384 00000100:00100000:0.0:1788833273.784610:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920384 00000100:00100000:0.0:1788833273.784637:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788833273.784643:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265920256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833273.784696:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265920256:12345-0@lo:400:kworker.0 Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833273.784702:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788833273.784715:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788833273.784721:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265920384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833273.784747:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265920384:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833273.784753:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788833273.784781:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788833273.784815:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce902701f80 x1875727265920384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833273.784830:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265920384:0@lo:400:kworker.0 00010000:00080000:0.0:1788833273.784841:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce902700e00 x1875727265920256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833273.784862:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265920256:0@lo:400:kworker.0 00000100:00100000:0.0:1788833273.784895:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3279:1875727265919872:0@lo:400:kworker.0 00000100:00080000:2.0:1788833273.785543:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788833273.785550:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265915264:0@lo:8:kworker.0 00000100:00100000:2.0:1788833273.785581:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265920000:0@lo:8:kworker.0 00000100:00100000:2.0:1788833273.785636:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833273.785805:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920000 00000100:00100000:1.0:1788833273.785821:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920000 00000100:00100000:1.0:1788833273.785862:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833273.785869:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3275:x1875727265920000:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788833273.785905:0:15073:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:1.0:1788833273.785951:0:15073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3ffb59 00002000:00100000:1.0:1788833273.785970:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cea3f6f5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788833273.785975:0:15073:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788833273.785978:0:15073:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788833273.786504:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788833273.786534:0:15073:0:(import.c:65:import_set_state_nolock()) ffff9cea3f6f0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833273.786605:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1875727265920000:12345-0@lo:8:kworker.0 Request processed in 735us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833273.786613:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788833273.786773:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce902700000 x1875727265920000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788833293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833273.786787:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788833273.786797:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788833273.786820:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788833273.786828:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788833273.786831:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ce9020d5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788833273.786859:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788833273.786866:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265920000:0@lo:8:kworker.0 00000100:00100000:2.0:1788833273.786877:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265920128:0@lo:8:kworker.0 00000100:00100000:2.0:1788833273.786917:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788833273.787116:0:14411:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788833273.787520:0:14411:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407853487533ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788833273.787572:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920128 00000100:00100000:0.0:1788833273.787580:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920128 00000100:00100000:0.0:1788833273.787610:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833273.787619:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3275:x1875727265920128:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788833273.787640:0:15074:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788833273.787779:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3275:x1875727265920128:12345-0@lo:8:kworker.0 Request processed in 159us (860us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788833273.787787:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1788833273.788257:0:14412:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788833273.788281:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14412:1875727265920640:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788833273.788327:0:14412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833273.788356:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833273.788399:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920640 00000100:00100000:1.0:1788833273.788404:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920640 00000100:00100000:1.0:1788833273.788451:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833273.788460:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14412:x1875727265920640:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788833273.789122:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265920512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833273.789167:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788833273.795532:0:15073:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788833273.795546:0:15073:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788833273.795552:0:15073:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:3.0:1788833273.799176:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788833273.799191:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788833273.799197:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265920128:0@lo:8:kworker.0 00000100:00100000:0.0:1788833273.809218:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920512 00000100:00100000:0.0:1788833273.809237:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920512 00000100:00100000:0.0:1788833273.809967:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788833273.809980:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875727265920512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788833273.810062:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833273.810163:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875727265920512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (20995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833273.810171:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00010000:1.0:1788833273.810854:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.810865:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.810894:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.810900:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.810907:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.810928:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.810941:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.810950:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.810973:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833273.810987:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.812532:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.812548:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.812553:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.812565:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.812605:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.812614:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.812636:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.812639:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.812641:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.815507:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.815523:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815545:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.815551:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.815559:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815576:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815587:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815596:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815631:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833273.815647:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.815654:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815662:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fada00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.815666:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815676:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815774:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815782:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffb67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.815803:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.815805:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.815807:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.816476:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.816484:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816497:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.816508:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.816514:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816525:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816534:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816542:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816559:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833273.816570:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.816575:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816583:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02facc00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.816586:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816594:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816606:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816625:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffb6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.816641:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.816643:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.816644:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788833273.817176:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788833273.817501:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.817509:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.817522:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.817526:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.817532:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.817543:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.817553:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.817560:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.817629:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833273.818240:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.818247:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.818260:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.818264:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.818268:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.818277:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.818286:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.818294:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788833273.818438:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea05caad80 x1875727265920512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833273.818483:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265920512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788833273.819357:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788833273.819377:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819391:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.819396:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819406:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819434:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819441:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffb75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819468:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833273.819472:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819479:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.819483:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819490:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819513:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.819522:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.819523:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.819525:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.819764:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.819798:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788833273.819806:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833273.825358:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.825376:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825399:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.825411:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.825419:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825437:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825449:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825458:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825482:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833273.825498:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.825505:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825514:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.825519:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825528:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825550:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825568:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.825591:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.825594:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.825595:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.831653:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.831667:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.833947:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.833956:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.833966:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.833988:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.834289:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.834297:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.834781:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833273.840494:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833273.840515:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.840533:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.840539:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.840552:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.840583:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.840592:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffb8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.841137:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.841142:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.841144:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.848243:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.848273:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848297:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.848302:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.848310:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848327:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848589:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848600:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848622:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833273.848639:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.848646:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848654:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.848660:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848669:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848712:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848720:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffb91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.848744:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.848746:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.848748:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788833273.855625:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788833273.868186:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.868206:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868228:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.868234:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.868241:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868259:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868272:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868280:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868341:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833273.868365:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.868371:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868379:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.868383:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868391:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868411:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868419:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffb98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.868445:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.868447:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.868448:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.869852:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.869867:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.869885:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.869901:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.869909:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.869923:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.869934:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.869942:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.869971:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833273.874139:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.874162:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874189:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.874194:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.874203:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874224:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874239:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874261:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874292:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788833273.874320:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788833273.874330:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874341:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.874347:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874357:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874381:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874414:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffb9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874441:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.874445:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874464:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02facc00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.874468:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874476:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874486:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874493:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffba6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.874507:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.874509:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.874511:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.874576:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.879138:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.879156:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.879179:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.879184:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.879192:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.879210:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.879232:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.879240:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.879261:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833273.879950:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.879959:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.879971:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.879975:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.879980:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880089:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880100:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880107:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880134:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788833273.880606:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.880612:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880622:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.880625:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.880630:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880640:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880649:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880657:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.880666:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788833273.881392:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.881402:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.881414:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.881423:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.881427:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.881439:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.881448:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.881457:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.881467:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788833273.882113:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788833273.882126:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788833273.882131:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882171:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.882176:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882187:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882212:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882222:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54df36f/0x8c08e876ed3ffbad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882250:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788833273.882255:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882262:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.882267:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882275:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882289:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882304:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f02e2d2/0x8c08e876ed3ffbbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882321:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833273.882326:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882334:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.882337:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882345:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833273.882368:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788833273.882375:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.882378:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882408:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ed45516/0x8c08e876ed3ffbc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.882413:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.882418:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.882423:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882449:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.882450:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.882454:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.882458:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.882481:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.882489:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.883117:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833273.884487:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.884499:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.884517:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.884523:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.884530:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.884545:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.884555:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.884562:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.886647:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788833273.886664:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.886695:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fade00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.886699:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.886710:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.886734:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.886741:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034782772/0x8c08e876ed3ffbc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.887282:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833273.887290:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.887299:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02face00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833273.887302:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.887310:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.887331:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.887340:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.887341:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.887351:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.890082:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788833273.890103:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007acfa6a/0x8c08e876ed3ffbd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833273.891527:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.891543:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.891564:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.891569:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.891577:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.891595:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.891606:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.891615:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.891626:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833273.891906:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833273.891916:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.891926:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833273.891931:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.891942:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.891962:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.891971:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000decd76a4/0x8c08e876ed3ffbd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.892006:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.892008:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.892010:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.892694:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.892710:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.892724:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fada00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.892731:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.892744:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.892770:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.892794:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f13921/0x8c08e876ed3ffbb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.892825:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.892828:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.892831:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.892836:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.892838:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.892871:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.892880:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.892900:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.892906:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.892913:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.892926:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.892936:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.892944:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.892963:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833273.892979:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833273.892987:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.892995:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833273.892999:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.893008:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.893055:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.893063:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd534186/0x8c08e876ed3ffbde lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.893082:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.893084:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.893086:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.893471:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.893477:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.893487:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.893491:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.893498:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.893510:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.893531:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.893538:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.893561:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833273.894559:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.894570:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.894585:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.894589:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.894594:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.894606:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.894616:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.894624:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.894762:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788833273.895649:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.895660:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.895674:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.895894:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.895902:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.895916:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.895927:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.895936:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896121:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788833273.896133:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896143:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fadc00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833273.896148:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896173:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896194:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896203:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f64af91/0x8c08e876ed3ffbe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896235:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833273.896239:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896247:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833273.896250:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896258:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896269:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896277:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011ae5262/0x8c08e876ed3ffbec lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896303:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833273.896306:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896313:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fac600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833273.896316:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896324:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896335:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833273.896343:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.896345:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833273.896347:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.897053:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.908852:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788833273.908871:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016ddbe6c/0x8c08e876ed3ffbf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.909190:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.915608:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.915624:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.915654:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.915659:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.915666:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.916267:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.916286:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.916297:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.916344:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833273.916520:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833273.916536:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.916553:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02facc00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.916559:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.916570:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.916596:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.916604:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003144f938/0x8c08e876ed3ffbfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.916639:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.916665:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.916669:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.918237:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.918252:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.918271:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.918277:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.918284:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.918300:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.918324:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.918333:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.918359:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833273.919178:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.919187:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.919201:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.919204:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.919209:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.919221:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.919231:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.919240:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.919271:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788833273.919761:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788833273.919779:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919788:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833273.919793:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919803:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919824:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919830:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63ea151/0x8c08e876ed3ffc01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919856:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833273.919861:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919866:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02fad600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833273.919869:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919876:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919897:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919904:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3149668/0x8c08e876ed3ffc08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833273.919915:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.919917:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.919919:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833273.919929:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.924278:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.924295:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.924318:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.924323:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.924331:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.924349:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.924361:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.924370:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.924401:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833273.925459:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833273.925475:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.925490:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932e800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833273.925496:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.925508:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.925531:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.925539:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d88eeeb7/0x8c08e876ed3ffc0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833273.925565:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.925567:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833273.925568:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833273.927291:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833273.927310:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.927331:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788833273.927348:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833273.927356:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.927374:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.927385:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.927393:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.927419:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788833273.927746:0:15073:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788833273.927890:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14412:x1875727265920640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 139426us (139556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833273.927901:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788833273.931454:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833273.931469:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.931485:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932ec00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833273.931491:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.931503:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.931545:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.931552:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d566d5/0x8c08e876ed3ffc16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833273.931576:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.931578:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833273.931580:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833273.935379:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14412:1875727265920640:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788833273.935401:0:14412:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788833273.935450:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14412:1875727265920768:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788833273.935509:0:14412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833273.935589:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676480 going to sleep for 11 seconds 00000100:00100000:0.0:1788833273.938948:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920768 00000100:00100000:0.0:1788833273.938972:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920768 00000100:00100000:0.0:1788833273.941312:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833273.941344:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14412:x1875727265920768:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788833273.941417:0:15072:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788833273.965572:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14412:x1875727265920768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24237us (30054us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788833273.965586:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788833273.967710:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14412:1875727265920768:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788833273.967730:0:14412:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788833274.029767:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833275.056197:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788833275.137360:0:15789:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788833275.137366:0:15789:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788833275.137497:0:15789:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ce90343a800 00000020:01000004:3.0:1788833275.137518:0:15789:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788833275.137534:0:15789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788833275.137551:0:15789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cea069919b8) 00000020:00000080:3.0:1788833275.137570:0:15789:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788833275.160408:0:15789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788833275.160711:0:15789:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788833275.162340:0:15789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788833275.162595:0:15789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788833275.162841:0:15789:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788833275.163590:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 169: rc = 0 00100000:10000000:2.0:1788833275.163696:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 169: rc = 0 00100000:10000000:2.0:1788833275.163795:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 169: rc = 0 00100000:10000000:2.0:1788833275.164574:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1788833275.164826:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1788833275.165723:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 642: rc = 0 00100000:10000000:2.0:1788833275.166276:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 642: rc = 0 00100000:10000000:2.0:1788833275.166544:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:2.0:1788833275.166798:0:15789:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 642: rc = 0 00000020:00000080:2.0:1788833275.168230:0:15789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788833275.168441:0:15789:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788833275.168458:0:15789:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c08e876ed3ffc24 00000020:01000004:2.0:1788833275.168468:0:15789:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788833275.168498:0:15789:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788833275.168502:0:15789:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788833275.168510:0:15789:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788833275.168540:0:15789:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788833275.168545:0:15789:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788833275.184693:0:15789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788833275.184732:0:15789:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.155@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788833275.184736:0:15789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788833275.184738:0:15789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788833275.184739:0:15789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788833275.184741:0:15789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788833275.184742:0:15789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788833275.184743:0:15789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788833275.184745:0:15789:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788833275.184747:0:15789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788833275.184748:0:15789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788833275.184752:0:15789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788833275.184754:0:15789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788833275.184756:0:15789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788833275.184757:0:15789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788833275.184758:0:15789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788833275.184759:0:15789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788833275.184761:0:15789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788833275.184762:0:15789:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788833275.184768:0:15789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788833275.184769:0:15789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788833275.184794:0:15789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788833275.184814:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265920896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788833275.184896:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.185060:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538540 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.192188:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265920896 00000100:00100000:0.0:1788833275.192206:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265920896 00000100:00100000:1.0:1788833275.194020:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788833275.194048:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15789:x1875727265920896:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788833275.194086:0:14382:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788833275.194101:0:14382:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788833275.194105:0:14382:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788833275.212315:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15789:x1875727265920896:12345-0@lo:253:mount.lustre.0 Request processed in 18267us (27401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833275.212334:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788833275.212505:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265920896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788833275.212525:0:15789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788833275.212528:0:15789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788833275.212529:0:15789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788833275.212531:0:15789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788833275.212532:0:15789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788833275.212533:0:15789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788833275.212535:0:15789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788833275.212536:0:15789:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788833275.212538:0:15789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788833275.212539:0:15789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788833275.212567:0:15789:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce90343a800 from lustre-OST0001 10000000:01000000:1.0:1788833275.212598:0:15789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788833275.212601:0:15789:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788833275.212611:0:15789:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cea3f713370 local copy 00010000:00010000:1.0:1788833275.212624:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833275.213110:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833275.213180:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.213233:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.213573:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921024 00000100:00100000:0.0:1788833275.213583:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921024 00000100:00100000:0.0:1788833275.213651:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788833275.213662:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15789:x1875727265921024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833275.213973:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15789:x1875727265921024:12345-0@lo:501:mount.lustre.0 Request processed in 312us (791us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788833275.213982:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788833275.214375:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921024:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788833275.214401:0:15789:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788833275.214574:0:15789:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788833275.214584:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.214596:0:15789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f037600/0x8c08e876ed3ff9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ff9d8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833275.214626:0:15789:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce90343a800 10000000:01000000:1.0:1788833275.214631:0:15789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788833275.214637:0:15789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788833275.214640:0:15789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788833275.214645:0:15789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788833275.214647:0:15789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788833275.214682:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3ffc2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.214690:0:15789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3ffc2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.214701:0:15789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3ffc2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833275.214721:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788833275.214766:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.214810:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833275.214906:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921152 00000100:00100000:2.0:1788833275.214914:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921152 00000100:00100000:2.0:1788833275.215164:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788833275.215174:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:15789:x1875727265921152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833275.215186:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833275.215202:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea1f036200/0x8c08e876ed3ffc32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffc2b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.215229:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f036200/0x8c08e876ed3ffc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc2b expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.215242:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea1f036200/0x8c08e876ed3ffc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc2b expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.215251:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea1f036200, rc 0) 00000100:00100000:2.0:1788833275.215300:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921152:12345-0@lo:101:mount.lustre.0 Request processed in 128us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833275.215307:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788833275.215577:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788833275.215598:0:15789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3ffc2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc32 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.215608:0:15789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3ffc2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffc32 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833275.216379:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788833275.217402:0:15789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833275.217711:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788833275.217760:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788833275.217794:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788833275.217844:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788833275.217876:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788833275.217908:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788833275.217982:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788833275.217991:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788833275.218136:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833275.218214:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.218262:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.218767:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921280 00000100:00100000:0.0:1788833275.218793:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921280 00000100:00100000:0.0:1788833275.218861:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788833275.218875:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833275.219489:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921280:12345-0@lo:501:mount.lustre.0 Request processed in 617us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833275.219498:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788833275.220545:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833275.220620:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833275.220698:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.220738:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.220803:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921408 00000100:00100000:0.0:1788833275.220811:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921408 00000100:00100000:0.0:1788833275.220874:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788833275.220891:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833275.221770:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921408:12345-0@lo:503:mount.lustre.0 Request processed in 871us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.221785:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788833275.222086:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921408:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788833275.228661:0:15789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788833275.228799:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833275.229080:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.229147:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea12538a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788833275.229366:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921536 00000100:00100000:3.0:1788833275.229376:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921536 00000100:00100000:3.0:1788833275.229443:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788833275.229453:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833275.229802:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921536:12345-0@lo:502:mount.lustre.0 Request processed in 350us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833275.229811:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788833275.230299:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788833275.230607:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788833275.230670:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788833275.230705:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788833275.230759:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788833275.230799:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788833275.230835:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788833275.230907:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788833275.230942:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788833275.231208:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788833275.231259:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833275.231340:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833275.231384:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea033933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.232280:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921664 00000100:00100000:0.0:1788833275.232292:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921664 00000100:00100000:0.0:1788833275.232366:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788833275.232378:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f429850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833275.232674:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f429850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921664:12345-0@lo:502:mount.lustre.0 Request processed in 297us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833275.232682:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788833275.233235:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788833275.233382:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788833275.233402:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788833275.234720:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788833275.234733:0:15790:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788833275.234742:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833275.234745:0:15790:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788833275.234755:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788833275.234776:0:15790:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cea1f7899b8) 00000020:00000080:2.0:1788833275.234809:0:15790:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788833275.234818:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788833275.234942:0:15790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce90343a800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788833275.235115:0:15790:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788833275.235133:0:15790:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c08e876ed3ffc40 00010000:00010000:3.0:1788833275.248377:0:15790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788833275.248838:0:15790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788833275.258142:0:15790:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788833275.266811:0:15790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788833275.266829:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833275.266838:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833275.266840:0:15790:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788833275.266844:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788833275.266848:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833275.266849:0:15790:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788833275.273806:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788833275.273809:0:15790:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788833275.273814:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833275.273825:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833275.273827:0:15790:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788833275.273830:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788833275.273834:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833275.273836:0:15790:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788833275.273839:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788833275.273942:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833275.274076:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833275.274079:0:15790:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788833275.274084:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788833275.278987:0:15789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788833275.279078:0:15789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788833275.279106:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3ffc2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc32 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.279122:0:15789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea3932e600/0x8c08e876ed3ffc2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc32 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833275.279132:0:15789:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce90343a800 from 1 10000000:01000000:2.0:1788833275.279135:0:15789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788833275.279195:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.279204:0:15789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.279216:0:15789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833275.279475:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833275.279563:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833275.279618:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea03393a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833275.279675:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921792 00000100:00100000:1.0:1788833275.279684:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921792 00000100:00100000:1.0:1788833275.279746:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788833275.279757:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f428450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:15789:x1875727265921792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788833275.279773:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833275.279790:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffc47 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.279822:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.279834:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.279843:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e400, rc 0) 00000100:00100000:1.0:1788833275.279909:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f428450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265921792:12345-0@lo:101:mount.lustre.0 Request processed in 154us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.279916:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788833275.280166:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833275.280185:0:15789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833275.280219:0:15789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788833275.281419:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788833275.281801:0:15789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788833275.282502:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788833275.282556:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788833275.282621:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788833275.282630:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788833275.282736:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833275.282829:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833275.284109:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833275.287265:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265921920 00000100:00100000:1.0:1788833275.287286:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265921920 00000100:00100000:1.0:1788833275.287375:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788833275.287388:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265921920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833275.287813:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265921920:12345-0@lo:501:mount.lustre.0 Request processed in 426us (4983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.287822:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788833275.288690:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265921920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833275.288765:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788833275.288843:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833275.288899:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833275.289089:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922048 00000100:00100000:2.0:1788833275.289096:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922048 00000100:00100000:2.0:1788833275.289152:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788833275.289161:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265922048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788833275.289543:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265922048:12345-0@lo:503:mount.lustre.0 Request processed in 381us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833275.289551:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788833275.289748:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788833275.290553:0:15789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788833275.290648:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833275.290725:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833275.290778:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833275.291323:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922176 00000100:00100000:2.0:1788833275.291332:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922176 00000100:00100000:2.0:1788833275.291386:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833275.291410:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f428850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265922176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833275.291706:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f428850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265922176:12345-0@lo:502:mount.lustre.0 Request processed in 298us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833275.291714:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788833275.293382:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788833275.293786:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788833275.293875:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788833275.295228:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788833275.295328:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788833275.295385:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788833275.295447:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788833275.295486:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788833275.295519:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788833275.295585:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833275.295693:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833275.295763:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833275.295981:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922304 00000100:00100000:2.0:1788833275.295992:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922304 00000100:00100000:2.0:1788833275.296097:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788833275.296110:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265922304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833275.296360:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265922304:12345-0@lo:502:mount.lustre.0 Request processed in 252us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833275.296369:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788833275.298130:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788833275.298369:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788833275.298386:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788833275.301408:0:15794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833275.301425:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833275.301428:0:15794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788833275.301439:0:15794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce90343a800 00000020:00000080:2.0:1788833275.301441:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833275.301449:0:15794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833275.301452:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833275.301454:0:15794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788833275.301456:0:15794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833275.301459:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833275.301460:0:15794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788833275.301464:0:15794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce90343a800 00000020:00000080:2.0:1788833275.301466:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833275.301537:0:15794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833275.301542:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833275.301543:0:15794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788833275.301566:0:15794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833275.301569:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833275.301570:0:15794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788833275.301574:0:15794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce90343a800 00000020:00000080:2.0:1788833275.301576:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833275.301616:0:15794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833275.301620:0:15794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833275.301622:0:15794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788833275.301625:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788833275.308413:0:15789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788833275.308479:0:15789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833275.308511:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833275.308526:0:15789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833275.308600:0:15789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788833275.308604:0:15789:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce90343a800 10000000:01000000:3.0:1788833275.308607:0:15789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce90343a800 10000000:01000000:3.0:1788833275.308611:0:15789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788833275.308618:0:15789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ce90343a800 from 1 10000000:01000000:3.0:1788833275.308620:0:15789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788833275.308664:0:15789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3ffc55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833275.308672:0:15789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3ffc55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833275.308702:0:15789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3ffc55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833275.308733:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788833275.308821:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833275.308890:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06676cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833275.313525:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922432 00000100:00100000:1.0:1788833275.313555:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922432 00000100:00100000:1.0:1788833275.313688:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788833275.313700:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265922432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788833275.313723:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833275.313744:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3ffc5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffc55 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.313779:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3ffc5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc55 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.313792:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932f600/0x8c08e876ed3ffc5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc55 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.313803:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f600, rc 0) 00000100:00100000:1.0:1788833275.314071:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922432:12345-0@lo:101:mount.lustre.0 Request processed in 373us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.314080:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788833275.325800:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788833275.325843:0:15789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3ffc55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc5c expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833275.326254:0:15789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3ffc55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffc5c expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833275.328250:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788833275.331294:0:15789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833275.334452:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788833275.334570:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788833275.334607:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788833275.334680:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788833275.334721:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788833275.339722:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788833275.339859:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788833275.339911:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788833275.340181:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788833275.340229:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788833275.340264:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788833275.340313:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788833275.340351:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788833275.340387:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788833275.340433:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788833275.340487:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788833275.340517:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788833275.340565:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788833275.340598:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788833275.340629:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788833275.340674:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788833275.340709:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788833275.340741:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788833275.340786:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788833275.340822:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788833275.340857:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788833275.340912:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788833275.340946:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788833275.345236:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788833275.345345:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788833275.345383:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788833275.345447:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788833275.345482:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788833275.345532:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788833275.345571:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788833275.345624:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788833275.345674:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788833275.345801:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788833275.345810:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788833275.347143:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833275.347238:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.347299:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce9020df300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.347406:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922560 00000100:00100000:0.0:1788833275.347416:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922560 00000100:00100000:0.0:1788833275.347487:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788833275.347498:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833275.347831:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922560:12345-0@lo:501:mount.lustre.0 Request processed in 333us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833275.347841:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788833275.348236:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833275.348293:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833275.348348:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.348451:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce9020df300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.354246:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922688 00000100:00100000:0.0:1788833275.354273:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922688 00000100:00100000:0.0:1788833275.354382:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788833275.354395:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833275.354822:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922688:12345-0@lo:503:mount.lustre.0 Request processed in 430us (6473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833275.354831:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788833275.355326:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788833275.364764:0:15789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788833275.364913:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833275.365176:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.365232:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce9020df300 going to sleep for 11 seconds 00000100:00100000:2.0:1788833275.365561:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922816 00000100:00100000:2.0:1788833275.365572:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922816 00000100:00100000:2.0:1788833275.365652:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788833275.365665:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833275.366276:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922816:12345-0@lo:502:mount.lustre.0 Request processed in 611us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833275.366287:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788833275.367386:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833275.367773:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788833275.367841:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788833275.369100:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788833275.369188:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788833275.369230:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788833275.369281:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788833275.369339:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788833275.369373:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788833275.369423:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788833275.369459:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788833275.369493:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788833275.369556:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788833275.369593:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788833275.369627:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788833275.369689:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788833275.369727:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788833275.369760:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788833275.369822:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788833275.369876:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788833275.369910:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788833275.369959:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788833275.369993:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788833275.370085:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788833275.370132:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788833275.370167:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788833275.370200:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788833275.370248:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788833275.370283:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788833275.370313:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788833275.370358:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788833275.370392:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788833275.370424:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788833275.370457:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788833275.370521:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788833275.370555:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788833275.370617:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788833275.370657:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788833275.370690:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788833275.370753:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788833275.370786:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788833275.370854:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833275.370954:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.371059:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ce9020df300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.371891:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265922944 00000100:00100000:0.0:1788833275.371904:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265922944 00000100:00100000:0.0:1788833275.371981:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788833275.371994:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833275.372389:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265922944:12345-0@lo:502:mount.lustre.0 Request processed in 397us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833275.372398:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788833275.377847:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265922944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833275.378559:0:15789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788833275.378581:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788833275.381499:0:15799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788833275.381521:0:15799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cea10ad4d28) 00000020:00000080:2.0:1788833275.381549:0:15799:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788833275.381630:0:15799:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce90343a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788833275.381634:0:15799:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce90343a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788833275.381637:0:15799:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce90343a800 3 00010000:00080000:2.0:1788833275.381674:0:15799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce901270000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1788833275.383578:0:15799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788833275.383835:0:15799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788833275.383885:0:15799:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788833275.383902:0:15799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8c08e876ed3ffc6a 00000100:00080000:2.0:1788833275.383916:0:15799:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788833275.383923:0:15799:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ce901270000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833275.383971:0:15799:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40eac380 x1875727265923072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788833275.384063:0:15799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788833275.384130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788833275.384135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788833275.384138:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788833275.384142:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1788833275.384147:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788833275.384151:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cea0350c800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833275.384166:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40eace00 x1875727265923328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788833275.384677:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265923200:0@lo:400:kworker.0 00000100:00100000:0.0:1788833275.384772:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.387188:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923200 00000100:00100000:1.0:1788833275.387207:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923200 00000100:00100000:1.0:1788833275.387301:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833275.387318:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265923200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833275.387435:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265923200:12345-0@lo:400:kworker.0 Request processed in 123us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.387444:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788833275.389061:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833275.389127:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265923200:0@lo:400:kworker.0 00000100:00100000:3.0:1788833275.389252:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875727265923072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788833275.389328:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833275.389386:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265923328:0@lo:8:kworker.0 00000100:00100000:3.0:1788833275.389414:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833275.389496:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923072 00000100:00100000:0.0:1788833275.389503:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923072 00000100:00100000:2.0:1788833275.389669:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265923456:0@lo:400:kworker.0 00000100:00100000:2.0:1788833275.389702:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833275.389795:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923328 00000100:00100000:1.0:1788833275.389801:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923328 00000100:00100000:1.0:1788833275.389828:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833275.389836:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875727265923328:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788833275.389931:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875727265923328:12345-0@lo:8:kworker.0 Request processed in 94us (515us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788833275.389938:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833275.389974:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788833275.389983:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788833275.389988:0:3275:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788833275.389992:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265923328:0@lo:8:kworker.0 00000100:00100000:2.0:1788833275.395693:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833275.395719:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265923584:0@lo:400:kworker.0 00000100:00100000:2.0:1788833275.395813:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833275.396127:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923456 00000100:00100000:0.0:1788833275.396139:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923456 00000100:00100000:1.0:1788833275.396369:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788833275.396382:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875727265923072:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788833275.396425:0:14389:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1788833275.396485:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8c08e876ed3ffc71 00000004:00100000:1.0:1788833275.396505:0:14389:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788833275.396564:0:14389:0:(import.c:65:import_set_state_nolock()) ffff9cea269a1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833275.397278:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875727265923072:12345-0@lo:38:llog_process_th.0 Request processed in 892us (7946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.397289:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788833275.397377:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788833275.397385:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265923456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833275.397430:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265923456:12345-0@lo:400:kworker.0 Request processed in 47us (7728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.397436:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788833275.397624:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40eac000 x1875727265923456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833275.397642:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265923456:0@lo:400:kworker.0 00000040:00080000:3.0:1788833275.398226:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1788833275.398580:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40eac380 x1875727265923072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833275.398593:0:3275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788833275.398602:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788833275.398612:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788833275.398617:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788833275.398621:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ce901270000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788833275.398628:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875727265923072:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788833275.399161:0:15789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788833275.399206:0:15789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788833275.399226:0:15789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3ffc55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc5c expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.399238:0:15789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01516000/0x8c08e876ed3ffc55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc5c expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788833275.399334:0:15789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788833275.399337:0:15789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788833275.399338:0:15789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833275.399340:0:15789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833275.399341:0:15789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833275.399343:0:15789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833275.399345:0:15789:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833275.399348:0:15789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833275.399349:0:15789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788833275.399354:0:15789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788833275.399357:0:15789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788833275.399358:0:15789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788833275.399359:0:15789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833275.399360:0:15789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833275.399361:0:15789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833275.399363:0:15789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833275.399364:0:15789:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833275.399365:0:15789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833275.399366:0:15789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788833275.399394:0:15789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788833275.399415:0:15789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265923712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788833275.399493:0:15789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833275.399537:0:15789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea397df600 going to sleep for 11 seconds 00000100:00100000:0.0:1788833275.399822:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923712 00000100:00100000:0.0:1788833275.399831:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923712 00000100:00100000:0.0:1788833275.400115:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788833275.400127:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:15789:x1875727265923712:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788833275.400163:0:14381:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788833275.400182:0:14381:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788833275.400912:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923584 00000100:00100000:1.0:1788833275.400921:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923584 00000100:00100000:1.0:1788833275.400984:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788833275.400994:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265923584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833275.401114:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875727265923584:12345-0@lo:400:kworker.0 Request processed in 123us (5302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833275.401123:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788833275.401195:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cea40eaea00 x1875727265923584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833275.401213:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875727265923584:0@lo:400:kworker.0 00000100:00080000:0.0:1788833275.401343:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1788833275.422431:0:14381:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788833275.422448:0:14381:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788833275.422493:0:14405:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788833275.422499:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788833275.422535:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.422559:0:14405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.422568:0:14405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.422636:0:14405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.422652:0:14405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 19 pid: 14381 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833275.422668:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14405:1875727265923840:0@lo:104: 00000100:00100000:2.0:1788833275.422751:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833275.422800:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea397df900 going to sleep for 11 seconds 00000100:00100000:2.0:1788833275.422843:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923840 00000100:00100000:2.0:1788833275.422859:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923840 00000100:00100000:2.0:1788833275.422905:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833275.422914:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14405:x1875727265923840:12345-0@lo:104: 00010000:00010000:2.0:1788833275.422927:0:14372:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.422981:0:14372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833275.422987:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:14405:x1875727265923840:12345-0@lo:104: Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833275.422995:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788833275.423062:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833275.423069:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423077:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:2.0:1788833275.423082:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423103:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833275.423110:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833275.423117:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833275.423152:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423160:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833275.423183:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423190:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea0925b200/0x8c08e876ed3ffb4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffb52 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423208:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833275.423210:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833275.423212:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833275.423234:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265923968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833275.423267:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833275.423305:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265923968 00000100:00100000:2.0:1788833275.423309:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265923968 00010000:00010000:2.0:1788833275.423328:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 20 pid: 14381 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833275.423354:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833275.423360:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+20:3278:x1875727265923968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833275.423379:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833275.423385:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 20 pid: 14381 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423395:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 20 pid: 14381 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423415:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423423:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788833275.423437:0:14376:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006629962s 00010000:00010000:2.0:1788833275.423442:0:14376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423449:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423457:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423463:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423468:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833275.423472:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423479:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423497:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423507:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833275.423538:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+20:3278:x1875727265923968:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833275.423545:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833275.423585:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265923968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833275.423608:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea0925a600/0x8c08e876ed3ffb52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3ffb4b expref: 19 pid: 14381 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833275.423617:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14405:1875727265923840:0@lo:104: 00010000:00010000:2.0:1788833275.423626:0:14405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423635:0:14405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423641:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833275.423647:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea1f037800/0x8c08e876ed3ffc78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833275.433115:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:15789:x1875727265923712:12345-0@lo:253:mount.lustre.0 Request processed in 32977us (33607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833275.433135:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788833275.433269:0:15789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b1386bc-e40b-4aca-a224-131a3ddd4df1:15789:1875727265923712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788833275.433289:0:15789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788833275.433293:0:15789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788833275.433312:0:15789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788833275.433314:0:15789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833275.433315:0:15789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833275.433317:0:15789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833275.433318:0:15789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833275.433320:0:15789:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833275.433323:0:15789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833275.433324:0:15789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788833275.433344:0:15789:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788833275.438195:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833275.438376:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833275.438556:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833275.438705:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833275.438854:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833275.439135:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788833275.440579:0:15789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788833275.494995:0:15789:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788833275.495018:0:15789:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788833275.495097:0:15789:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788833275.495175:0:15789:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788833275.495194:0:15789:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788833275.495228:0:15789:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788833276.081254:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788833276.781123:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788833276.781133:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cea3f68e000 from 8 10000000:01000000:2.0:1788833276.781140:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788833276.781197:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f036000/0x8c08e876ed3ffc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833276.781212:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea1f036000/0x8c08e876ed3ffc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833276.781225:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea1f036000/0x8c08e876ed3ffc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833276.781810:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265924096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788833276.781924:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833276.781997:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea08a8bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833276.782997:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924096 00000100:00100000:0.0:1788833276.783018:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924096 00000100:00100000:0.0:1788833276.783136:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788833276.783148:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:14385:x1875727265924096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833276.783169:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833276.783192:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea0925a400/0x8c08e876ed3ffc86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffc7f expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833276.783225:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea0925a400/0x8c08e876ed3ffc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc7f expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833276.784335:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea0925a400/0x8c08e876ed3ffc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc7f expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833276.784363:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a400, rc 0) 00000100:00100000:0.0:1788833276.784466:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265924096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1318us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833276.784475:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788833276.784575:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265924096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833276.784599:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea1f036000/0x8c08e876ed3ffc7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc86 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833276.784629:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea1f036000/0x8c08e876ed3ffc7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffc86 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833276.784706:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265924224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788833276.786983:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833276.787058:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02bbacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833276.787087:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924224 00000100:00100000:0.0:1788833276.787097:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924224 00000100:00100000:0.0:1788833276.787161:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788833276.787171:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265924224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788833276.787202:0:14381:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788833276.787233:0:14381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788833276.789341:0:14381:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788833276.789542:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265924224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2368us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833276.789555:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788833276.789638:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265924224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788833276.790830:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788833276.790970:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea1f036000/0x8c08e876ed3ffc7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc86 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833276.790986:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea1f036000/0x8c08e876ed3ffc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffc86 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833277.114299:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788833277.189905:0:6679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788833277.191176:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788833278.137589:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833279.091012:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788833279.091060:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265924352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833279.091127:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833279.091238:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924352 00000100:00100000:1.0:1788833279.091246:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924352 00000100:00100000:1.0:1788833279.091306:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833279.091315:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265924352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833279.091346:0:15076:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833279.091392:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265924352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833279.091408:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833279.091448:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788833279.091466:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265924352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788833279.091661:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788833279.149160:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833280.173151:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788833280.495614:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788833280.621332:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788833280.621348:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788833280.621353:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788833280.621368:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cea0350c800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1788833280.621400:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cea40eac000 x1875727265924736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788833280.621500:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265924608:0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.621600:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.621777:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788833280.621785:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3277:1875727265924480:0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.621819:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.621843:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265925120:0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.621874:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.621907:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265924992:0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.621932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.621951:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833280.621956:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265924864:0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.621977:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.622049:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265925120 00000100:00100000:2.0:1788833280.622059:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265925120 00000100:00100000:2.0:1788833280.622113:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924992 00000100:00100000:2.0:1788833280.622116:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924992 00000100:00100000:2.0:1788833280.622131:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924864 00000100:00100000:2.0:1788833280.622133:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924864 00000100:00100000:2.0:1788833280.622151:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833280.622160:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265925120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.622216:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265925120:12345-0@lo:400:kworker.0 Request processed in 56us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833280.622230:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833280.622248:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833280.622254:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265924992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.622286:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875727265924992:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833280.622292:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833280.622303:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833280.622310:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265924864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.622337:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265924864:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833280.622342:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788833280.622362:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833280.622787:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924608 00000100:00100000:1.0:1788833280.622792:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924608 00000100:00100000:1.0:1788833280.622823:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833280.622830:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265924608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833280.622872:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265924608:12345-0@lo:400:kworker.0 Request processed in 43us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833280.622878:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788833280.624209:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40eaea00 x1875727265924864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833280.624229:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265924864:0@lo:400:kworker.0 00010000:00080000:2.0:1788833280.624244:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40eac380 x1875727265924992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833280.624252:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875727265924992:0@lo:400:kworker.0 00010000:00080000:2.0:1788833280.624298:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40eace00 x1875727265925120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833280.624307:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265925120:0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.624321:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265924608:0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.627783:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924480 00000100:00100000:2.0:1788833280.627807:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924480 00000100:00100000:2.0:1788833280.627949:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788833280.627961:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3277:x1875727265924480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833280.628109:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3277:x1875727265924480:12345-0@lo:400:kworker.0 Request processed in 151us (6289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833280.628118:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788833280.628169:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265924736:0@lo:8:kworker.0 00000100:00100000:2.0:1788833280.628209:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.628272:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3277:1875727265924480:0@lo:400:kworker.0 00000100:00100000:1.0:1788833280.628449:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265924736 00000100:00100000:1.0:1788833280.628454:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265924736 00000100:00100000:1.0:1788833280.628478:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788833280.628484:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3275:x1875727265924736:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788833280.628514:0:15073:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:1.0:1788833280.628558:0:15073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c08e876ed3ffc8d 00002000:00100000:1.0:1788833280.628575:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cea269a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788833280.628579:0:15073:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788833280.628583:0:15073:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788833280.630109:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788833280.630155:0:15073:0:(import.c:65:import_set_state_nolock()) ffff9cea269a7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833280.630257:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1875727265924736:12345-0@lo:8:kworker.0 Request processed in 1770us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833280.630267:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788833280.630902:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea40eac000 x1875727265924736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788833305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788833280.630922:0:3275:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788833280.630933:0:3275:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788833280.630940:0:3275:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788833280.630943:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9cea0350c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788833280.631014:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788833280.631021:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875727265924736:0@lo:8:kworker.0 00000004:00080000:0.0:1788833280.631079:0:14413:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788833280.631532:0:14413:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414697499916ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788833280.632491:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265925248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833280.632573:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833280.632666:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265925248 00000100:00100000:1.0:1788833280.632681:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265925248 00000100:00100000:1.0:1788833280.632749:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833280.632760:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875727265925248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833280.632798:0:15076:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:2.0:1788833280.632995:0:14414:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788833280.633021:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14414:1875727265925376:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788833280.633071:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.633091:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea08d963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833280.633116:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265925376 00000100:00100000:2.0:1788833280.633120:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265925376 00000100:00100000:2.0:1788833280.633146:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833280.633151:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14414:x1875727265925376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788833280.636380:0:15072:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788833280.636476:0:15072:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788833280.636484:0:15072:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00080000:3.0:1788833280.638667:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788833280.639229:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265925248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6463us (6648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833280.639243:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788833280.639813:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cea114fa300 x1875727265925248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833280.640951:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265925248:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1788833280.648691:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.648705:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.648727:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.648732:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.648746:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.648768:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.648780:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.648789:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.648813:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.648829:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.648836:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.648844:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.648849:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.648859:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.649168:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.649191:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffc94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.649213:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.649215:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.649217:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.649965:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.649973:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.649995:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.649999:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.650004:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650016:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650025:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650060:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650083:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.650098:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.650110:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650119:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.650124:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650132:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650146:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650153:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c6d8eed/0x8c08e876ed3ffc9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650166:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.650168:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.650169:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.650596:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.650602:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.650613:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.650616:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.650621:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651104:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651114:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651122:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651139:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.651150:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.651154:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651162:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037a00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.651165:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651173:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651186:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651193:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51d9eb3/0x8c08e876ed3ffca2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.651217:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.651218:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.651220:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.652083:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.652093:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652109:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.652113:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.652120:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652131:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652139:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652147:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652168:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.652180:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.652186:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652205:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.652208:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652216:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652231:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652238:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b860449/0x8c08e876ed3ffca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.652254:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.652256:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.652258:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.653999:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.654016:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654051:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.654056:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.654063:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654079:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654105:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654115:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654133:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.654147:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.654153:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654161:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f036400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.654166:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654175:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654193:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654201:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffc973ea/0x8c08e876ed3ffcb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.654222:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.654230:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.654232:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.655949:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.655963:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.655991:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.655995:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.656002:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656017:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656028:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656071:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656114:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.656125:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.656131:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656139:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037e00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.656144:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656162:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656180:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656187:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028923768/0x8c08e876ed3ffcb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.656205:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.656206:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.656208:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.657092:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.657100:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657113:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.657116:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.657121:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657132:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657142:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657157:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657178:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.657192:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.657197:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657204:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.657208:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657216:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657232:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657240:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c8051d4/0x8c08e876ed3ffcbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.657258:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.657260:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.657262:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.658948:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.658970:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.658998:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.659002:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.659009:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659023:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659053:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659063:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659085:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.659098:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.659104:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659112:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00031200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.659117:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659127:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659154:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659161:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7aa30aa/0x8c08e876ed3ffcc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.659182:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.659184:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.659186:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.660085:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.660095:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660108:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.660112:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.660117:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660128:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660137:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660144:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660176:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.660191:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.660196:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660203:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00031e00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.660207:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660215:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660229:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660236:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000f688f7/0x8c08e876ed3ffccc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.660254:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.660255:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.660257:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.660977:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.660994:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661005:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.661015:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.661019:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661078:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661087:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661095:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661225:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.661235:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.661240:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661248:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00030000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.661251:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661260:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661274:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661291:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045c16d45/0x8c08e876ed3ffcd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.661306:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.661308:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.661310:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.662616:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.662626:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662649:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.662653:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.662659:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662672:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662681:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662689:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662706:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.662717:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.662728:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662736:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00030200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.662741:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662748:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662763:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662770:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031885d9f/0x8c08e876ed3ffcda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.662784:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.662787:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.662788:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.663523:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.663530:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663540:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.663543:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.663548:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663570:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663579:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663598:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663616:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.663629:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.663697:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663705:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00030600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.663709:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663718:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663732:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663740:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eab1a1f/0x8c08e876ed3ffce1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.663763:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.663765:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.663766:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.664298:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.664305:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664314:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.664317:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.664321:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664331:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664338:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664344:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664358:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.664367:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.664371:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664388:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00031000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.664392:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664400:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664413:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664421:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001297eb6/0x8c08e876ed3ffce8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.664435:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.664437:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.664438:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.665145:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.665152:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665162:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.665165:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.665169:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665179:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665194:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665201:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665216:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.665227:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.665232:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665240:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea00031a00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.665243:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665250:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665262:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665268:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046323a8f/0x8c08e876ed3ffcef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.665282:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.665289:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.665291:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.666207:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.666219:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.666232:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.666236:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.666242:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.666256:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.666267:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.666276:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.666348:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788833280.667204:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.667213:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.667226:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.667230:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.667234:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.667249:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.667258:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.667265:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669039:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788833280.669060:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669076:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833280.669082:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669094:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669139:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669148:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000392b8afc/0x8c08e876ed3ffcf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669179:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833280.669184:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669192:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833280.669195:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669202:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669212:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.669219:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833280.669221:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833280.669223:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.673202:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788833280.673223:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffcfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.673277:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.676355:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.676368:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.676390:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.676395:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.676403:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.676420:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.676445:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.676453:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678064:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.678084:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.678092:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678101:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.678106:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678118:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678142:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678150:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa5317c6/0x8c08e876ed3ffd04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678175:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.678188:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.678190:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.678901:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.678909:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678924:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.678929:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.678937:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678951:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678960:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678969:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.678997:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.679008:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.679013:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.679022:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382ae00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.679026:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.679066:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.679079:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.679086:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007376df1d/0x8c08e876ed3ffd0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.679102:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.679104:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.679105:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.680288:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.680301:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.680317:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.680321:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.680327:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.680339:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.680350:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.680365:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.680732:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788833280.681408:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.681417:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.681430:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.681434:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.681438:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.681450:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.681565:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833280.681574:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.681606:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382b600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833280.681611:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.681620:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.681765:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.681775:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a0f37e/0x8c08e876ed3ffd12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.681798:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833280.681800:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833280.681801:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.681900:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.681910:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.681968:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788833280.682524:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.682531:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.682549:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.682553:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.682558:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.682570:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.682578:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.682585:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.686930:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788833280.686951:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.686969:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382aa00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833280.686975:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687002:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687065:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687075:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000410f5f37/0x8c08e876ed3ffd19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687610:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833280.687618:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687627:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382b800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:0.0:1788833280.687708:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687719:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687735:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.687745:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833280.687746:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833280.687750:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.692491:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788833280.692515:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003925bd42/0x8c08e876ed3ffd20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833280.692710:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.696056:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.696390:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696414:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.696419:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.696428:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696518:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696532:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696541:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696576:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.696725:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.696733:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696742:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.696748:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696758:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696779:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696787:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5128c18/0x8c08e876ed3ffd27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.696889:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.696891:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.696893:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.698203:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.698214:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698231:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.698236:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.698243:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698257:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698269:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698279:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698298:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788833280.698778:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.698785:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698806:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.698809:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.698813:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698835:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698845:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698852:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698872:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788833280.698887:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833280.698894:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698902:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382b000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.698906:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698916:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698946:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698954:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b95a64a2/0x8c08e876ed3ffd2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698975:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.698978:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.698996:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a000 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.698999:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699008:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699019:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699026:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077a362d5/0x8c08e876ed3ffd35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699067:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.699069:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.699077:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.699516:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.699522:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699531:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.699534:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.699539:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699548:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699557:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699565:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699583:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.699593:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.699598:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699606:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382be00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.699609:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699630:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699641:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699649:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a2e54b/0x8c08e876ed3ffd3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.699664:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.699666:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.699667:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.700131:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.700138:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700147:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.700151:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.700155:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700165:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700173:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700192:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700208:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.700219:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.700224:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700231:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.700235:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700243:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700254:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700262:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f4ae17/0x8c08e876ed3ffd43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.700276:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.700277:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.700279:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833280.701283:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.702444:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.702485:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702506:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.702511:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.702518:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702534:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702546:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702554:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702575:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.702598:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.702604:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702613:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382ba00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.702618:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702627:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702661:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702669:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cda84af/0x8c08e876ed3ffd4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.702693:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.702695:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.702697:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833280.703392:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833280.703400:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703413:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788833280.703416:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833280.703421:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703431:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703441:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703449:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703477:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833280.703491:0:15713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833280.703496:0:15713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703504:0:15713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382b200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833280.703507:0:15713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703516:0:15713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703531:0:15713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703538:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d749dbd5/0x8c08e876ed3ffd51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833280.703556:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.703558:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833280.703559:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788833280.703900:0:15072:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788833280.704066:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14414:x1875727265925376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 70907us (70988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833280.704078:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833280.704158:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14414:1875727265925376:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788833280.704188:0:14414:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788833280.704242:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14414:1875727265925504:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788833280.704283:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833280.704349:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea08d963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833280.704371:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265925504 00000100:00100000:2.0:1788833280.704379:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265925504 00000100:00100000:2.0:1788833280.704428:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833280.704439:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14414:x1875727265925504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788833280.704492:0:15073:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:2.0:1788833280.711160:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788833280.723094:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14414:x1875727265925504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18641us (18796us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788833280.723112:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788833280.723743:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14414:1875727265925504:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788833280.723763:0:14414:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788833281.199781:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833282.225554:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788833282.824794:0:16147:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788833283.245139:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833284.206228:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788833284.206255:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265925632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833284.206346:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833284.206770:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265925632 00000100:00100000:1.0:1788833284.206778:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265925632 00000100:00080000:2.0:1788833284.206836:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833284.206851:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788833284.206862:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265925632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833284.206895:0:15076:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833284.206951:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265925632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833284.206958:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833284.207085:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265925632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788833284.270584:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833285.203208:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833285.203313:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493184 00000100:00100000:0.0:1788833285.203322:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493184 00000100:00100000:0.0:1788833285.203360:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:0.0:1788833285.203368:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea26c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2356:x1875727256493184:12345-192.168.206.55@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788833285.203402:0:14383:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 87cd922b-b578-4316-b54d-a31fbf32e6e4@192.168.206.55@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:0.0:1788833285.203431:0:14383:0:(genops.c:1385:class_connect()) connect: client 87cd922b-b578-4316-b54d-a31fbf32e6e4, cookie 0x8c08e876ed3ffd58 00000100:00080000:0.0:1788833285.203599:0:14383:0:(import.c:65:import_set_state_nolock()) ffff9cea05dec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788833285.203670:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea26c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+5:2356:x1875727256493184:12345-192.168.206.55@tcp:250:mount.lustre.0 Request processed in 301us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833285.203677:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 74 00000100:00100000:0.0:1788833285.207155:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.207488:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493312 00000100:00100000:2.0:1788833285.207504:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493312 00000100:00100000:2.0:1788833285.207877:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:2.0:1788833285.207888:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+5:13749:x1875727256493312:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788833285.207903:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833285.207919:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce90382ae00/0x8c08e876ed3ffd5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b220 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.207973:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce90382ae00/0x8c08e876ed3ffd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b220 expref: 6 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.207985:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce90382ae00/0x8c08e876ed3ffd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b220 expref: 6 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.207993:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382ae00, rc 0) 00000100:00100000:2.0:1788833285.208095:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+6:13749:x1875727256493312:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 209us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.208102:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 75 00000100:00100000:3.0:1788833285.213364:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.213630:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493440 00000100:00100000:2.0:1788833285.213643:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493440 00000100:00100000:2.0:1788833285.214000:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 76 00000100:00100000:2.0:1788833285.214012:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+6:13749:x1875727256493440:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788833285.219088:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+6:13749:x1875727256493440:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 4782us (5441us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788833285.219108:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 76 00000100:00100000:3.0:1788833285.227575:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.228942:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493568 00000100:00100000:2.0:1788833285.228970:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493568 00000100:00100000:2.0:1788833285.229126:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 77 00000100:00100000:2.0:1788833285.229141:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+6:13749:x1875727256493568:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788833285.229165:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833285.229191:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce90382a800/0x8c08e876ed3ffd66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b227 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.229237:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce90382a800/0x8c08e876ed3ffd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b227 expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.229273:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce90382a800/0x8c08e876ed3ffd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b227 expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.229285:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382a800, rc 0) 00000100:00100000:2.0:1788833285.229376:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+7:13749:x1875727256493568:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 239us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.229383:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 77 00000100:00100000:0.0:1788833285.242968:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.243342:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493696 00000100:00100000:2.0:1788833285.243355:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493696 00000100:00100000:2.0:1788833285.243427:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 78 00000100:00100000:2.0:1788833285.243440:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+7:13749:x1875727256493696:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788833285.243882:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13749:x1875727256493696:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 442us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.243891:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 78 00000100:00100000:3.0:1788833285.251589:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833285.251706:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493824 00000100:00100000:0.0:1788833285.251719:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493824 00000100:00100000:0.0:1788833285.251788:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:0.0:1788833285.251806:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13749:x1875727256493824:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788833285.252135:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13749:x1875727256493824:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 337us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833285.252145:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 79 00000100:00100000:3.0:1788833285.265165:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.265391:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256493952 00000100:00100000:2.0:1788833285.265403:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256493952 00000100:00100000:2.0:1788833285.265577:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:2.0:1788833285.265590:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13767:x1875727256493952:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788833285.268105:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13767:x1875727256493952:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 2502us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.268124:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 80 00010000:00010000:2.0:1788833285.295372:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833285.299183:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833285.299373:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494080 00000100:00100000:0.0:1788833285.299387:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494080 00000100:00100000:0.0:1788833285.299463:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 81 00000100:00100000:0.0:1788833285.299475:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13767:x1875727256494080:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833285.300212:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13767:x1875727256494080:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 735us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833285.300473:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 81 00000100:00100000:3.0:1788833285.312812:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.317861:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494208 00000100:00100000:2.0:1788833285.317882:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494208 00000100:00100000:2.0:1788833285.317981:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00100000:2.0:1788833285.318015:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+8:13749:x1875727256494208:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788833285.318061:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833285.318086:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce90382bc00/0x8c08e876ed3ffd6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b251 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.318127:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce90382bc00/0x8c08e876ed3ffd6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b251 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.318411:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce90382bc00/0x8c08e876ed3ffd6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b251 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.318422:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382bc00, rc 0) 00000100:00100000:2.0:1788833285.319015:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+9:13749:x1875727256494208:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 1001us (6220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.319024:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00100000:3.0:1788833285.339392:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833285.340488:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494336 00000100:00100000:0.0:1788833285.340505:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494336 00000100:00100000:1.0:1788833285.340819:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:1.0:1788833285.340840:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+9:13749:x1875727256494336:12345-192.168.206.55@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788833285.340867:0:14383:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788833285.340893:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788833285.340897:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788833285.340901:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788833285.340904:0:14383:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788833285.343016:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+9:13749:x1875727256494336:12345-192.168.206.55@tcp:256:mount.lustre.0 Request processed in 2176us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833285.343074:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:3.0:1788833285.347131:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.347252:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494464 00000100:00100000:2.0:1788833285.347263:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494464 00000100:00100000:2.0:1788833285.347310:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00100000:2.0:1788833285.347319:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+9:13749:x1875727256494464:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788833285.347337:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833285.347354:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b258 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.347382:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 10 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.347395:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 10 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833285.347425:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b400, rc 0) 00000100:00100000:2.0:1788833285.347483:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13749:x1875727256494464:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 164us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.347490:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 84 00000100:00100000:3.0:1788833285.350522:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833285.350794:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494592 00000100:00100000:1.0:1788833285.350815:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494592 00000100:00100000:1.0:1788833285.350876:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 85 00000100:00100000:1.0:1788833285.350886:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13749:x1875727256494592:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788833285.351592:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13749:x1875727256494592:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 705us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833285.351601:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 85 00000100:00100000:3.0:1788833285.355359:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833285.355629:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494720 00000100:00100000:0.0:1788833285.355639:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494720 00000100:00100000:0.0:1788833285.355988:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 86 00000100:00100000:0.0:1788833285.355999:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13749:x1875727256494720:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788833285.356931:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13749:x1875727256494720:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 930us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833285.356942:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 86 00000100:00100000:3.0:1788833285.362261:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.362840:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494848 00000100:00100000:2.0:1788833285.362850:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494848 00000100:00100000:2.0:1788833285.363013:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 87 00000100:00100000:2.0:1788833285.363024:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13772:x1875727256494848:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788833285.363290:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13772:x1875727256494848:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 267us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.363298:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 87 00000100:00100000:3.0:1788833285.365284:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833285.365365:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256494976 00000100:00100000:0.0:1788833285.365373:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256494976 00000100:00100000:0.0:1788833285.365476:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 88 00000100:00100000:0.0:1788833285.365486:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13772:x1875727256494976:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833285.366459:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13772:x1875727256494976:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 686us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833285.366470:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 88 00000100:00100000:3.0:1788833285.377124:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.377952:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256495104 00000100:00100000:2.0:1788833285.377973:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256495104 00000100:00100000:2.0:1788833285.378026:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:2.0:1788833285.378060:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1875727256495104:12345-192.168.206.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788833285.378094:0:14390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 70a01777-e892-436b-bb0e-1312d87c0a33@192.168.206.55@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:2.0:1788833285.378149:0:14390:0:(genops.c:1385:class_connect()) connect: client 70a01777-e892-436b-bb0e-1312d87c0a33, cookie 0x8c08e876ed3ffd7b 00000004:00100000:2.0:1788833285.379862:0:14390:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1788833285.379880:0:14390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788833285.473935:0:14390:0:(import.c:65:import_set_state_nolock()) ffff9cea05dea800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788833285.474138:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+6:2356:x1875727256495104:12345-192.168.206.55@tcp:38:mount.lustre.0 Request processed in 96078us (97021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833285.474150:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1788833285.477358:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833285.477456:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256495360 00000100:00100000:1.0:1788833285.477466:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256495360 00000100:00080000:2.0:1788833285.477649:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833285.477797:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:1.0:1788833285.477819:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+6:13749:x1875727256495360:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788833285.477870:0:14391:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788833285.477898:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833285.478085:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+6:13749:x1875727256495360:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 190us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833285.478121:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:1.0:1788833285.483679:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256495232 00000100:00100000:1.0:1788833285.483694:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256495232 00000100:00100000:1.0:1788833285.483755:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:1.0:1788833285.483765:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+6:0:x1875727256495232:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788833285.483794:0:14391:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788833285.483871:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+6:0:x1875727256495232:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 108us (5975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833285.483878:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:0.0:1788833285.486153:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833285.486330:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256495488 00000100:00100000:3.0:1788833285.486339:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256495488 00000100:00100000:3.0:1788833285.486385:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1788833285.486394:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:13749:x1875727256495488:12345-192.168.206.55@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788833285.486482:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:13749:x1875727256495488:12345-192.168.206.55@tcp:40:mount.lustre.0 Request processed in 89us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.486489:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:2.0:1788833285.490398:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.490497:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833285.491901:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833285.492139:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256495616 00000100:00100000:1.0:1788833285.492149:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256495616 00000100:00100000:1.0:1788833285.492200:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256495744 00000100:00100000:1.0:1788833285.492204:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256495744 00000100:00100000:1.0:1788833285.492220:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:1.0:1788833285.492228:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875727256495616:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788833285.492260:0:15072:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 70a01777-e892-436b-bb0e-1312d87c0a33@192.168.206.55@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:1.0:1788833285.492293:0:15072:0:(genops.c:1385:class_connect()) connect: client 70a01777-e892-436b-bb0e-1312d87c0a33, cookie 0x8c08e876ed3ffd82 00002000:00100000:1.0:1788833285.492304:0:15072:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 70a01777-e892-436b-bb0e-1312d87c0a33/ffff9cea269a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788833285.492315:0:15072:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788833285.492856:0:15072:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788833285.492885:0:15072:0:(import.c:65:import_set_state_nolock()) ffff9cea269a6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833285.492970:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:2356:x1875727256495616:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 741us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833285.492979:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:1.0:1788833285.493002:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1788833285.493008:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875727256495744:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788833285.493026:0:15072:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 70a01777-e892-436b-bb0e-1312d87c0a33@192.168.206.55@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:1.0:1788833285.493068:0:15072:0:(genops.c:1385:class_connect()) connect: client 70a01777-e892-436b-bb0e-1312d87c0a33, cookie 0x8c08e876ed3ffd89 00002000:00100000:1.0:1788833285.493075:0:15072:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 70a01777-e892-436b-bb0e-1312d87c0a33/ffff9cea269a6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788833285.493093:0:15072:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788833285.493211:0:15072:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788833285.493227:0:15072:0:(import.c:65:import_set_state_nolock()) ffff9cea269a3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833285.493252:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:2356:x1875727256495744:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 243us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833285.493272:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:3.0:1788833285.493383:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256495872 00000100:00100000:3.0:1788833285.493389:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256495872 00000100:00100000:3.0:1788833285.493432:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833285.493441:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:13749:x1875727256495872:12345-192.168.206.55@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788833285.502712:0:14392:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9216us 00000004:00200000:3.0:1788833285.525099:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788833285.526386:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:13749:x1875727256495872:12345-192.168.206.55@tcp:33:mount.lustre.0 Request processed in 32936us (34481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.526399:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833285.741746:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833285.741836:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833285.741926:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265926144:0@lo:400:kworker.0 00000100:00100000:1.0:1788833285.742008:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833285.742080:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265925760:0@lo:400:kworker.0 00000100:00100000:1.0:1788833285.742086:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea114f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265926272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833285.742132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833285.742191:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926144 00000100:00100000:1.0:1788833285.742196:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833285.742201:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926144 00000100:00100000:1.0:1788833285.742249:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265925760 00000100:00100000:1.0:1788833285.742254:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265925760 00000100:00100000:1.0:1788833285.742296:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788833285.742306:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3278:x1875727265925760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833285.742357:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3278:x1875727265925760:12345-0@lo:400:kworker.0 Request processed in 53us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833285.742365:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788833285.742504:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788833285.742512:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265926144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.742554:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875727265926144:12345-0@lo:400:kworker.0 Request processed in 43us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.742560:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788833285.742599:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902700000 x1875727265926144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833285.742614:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875727265926144:0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.742644:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265925760:0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.742685:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265926016:0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.742711:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833285.742731:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788833285.742737:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265925888:0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.742758:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833285.742811:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926016 00000100:00100000:3.0:1788833285.742815:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926016 00000100:00100000:3.0:1788833285.742859:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265925888 00000100:00100000:3.0:1788833285.742862:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265925888 00000100:00100000:3.0:1788833285.742878:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833285.742884:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265926016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.742920:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875727265926016:12345-0@lo:400:kworker.0 Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.742927:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833285.742939:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788833285.742965:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265925888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.742996:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265925888:12345-0@lo:400:kworker.0 Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.743002:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788833285.743288:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788833285.743328:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926272 00000100:00100000:2.0:1788833285.743332:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926272 00000100:00100000:2.0:1788833285.743370:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833285.743389:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265926272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833285.743403:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833285.743444:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875727265926272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833285.743450:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833285.743496:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea114f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265926272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833285.743742:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265926528:0@lo:400:kworker.0 00000100:00100000:2.0:1788833285.743903:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833285.743942:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265925888:0@lo:400:kworker.0 00000100:00100000:2.0:1788833285.743963:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265926016:0@lo:400:kworker.0 00000100:00100000:2.0:1788833285.743977:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788833285.743982:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265926400:0@lo:400:kworker.0 00000100:00100000:2.0:1788833285.744006:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833285.744148:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926528 00000100:00100000:2.0:1788833285.744153:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926528 00000100:00100000:2.0:1788833285.744190:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926400 00000100:00080000:3.0:1788833285.744192:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833285.744193:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926400 00000100:00100000:3.0:1788833285.744204:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788833285.744210:0:14389:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788833285.744212:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265926528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833285.744216:0:14389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1788833285.744231:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833285.744252:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875727265926528:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.744259:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788833285.744272:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788833285.744278:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265926400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833285.744368:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875727265926400:12345-0@lo:400:kworker.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.744375:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788833285.744399:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902702a00 x1875727265926400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833285.744411:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875727265926400:0@lo:400:kworker.0 00010000:00080000:1.0:1788833285.744426:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce902701880 x1875727265926528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833285.744448:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875727265926528:0@lo:400:kworker.0 00000100:00100000:2.0:1788833285.785546:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833285.787101:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496000 00000100:00100000:3.0:1788833285.787115:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496000 00000100:00100000:3.0:1788833285.787188:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:3.0:1788833285.787199:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+6:13793:x1875727256496000:12345-192.168.206.55@tcp:101:mkdir.0 00010000:00010000:3.0:1788833285.787217:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833285.787242:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ffd90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b282 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833285.787317:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517a00/0x8c08e876ed3ffd97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833285.787342:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517a00/0x8c08e876ed3ffd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833285.787355:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517a00/0x8c08e876ed3ffd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833285.787388:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788833285.787391:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833285.787440:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517a00/0x8c08e876ed3ffd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833285.787469:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517400/0x8c08e876ed3ffd90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b282 expref: 8 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833285.787488:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517a00/0x8c08e876ed3ffd97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b282 expref: 7 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833285.787496:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:3.0:1788833285.787500:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833285.787503:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517a00, rc 0) 00000100:00100000:3.0:1788833285.787577:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+7:13793:x1875727256496000:12345-192.168.206.55@tcp:101:mkdir.0 Request processed in 379us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833285.787584:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000001:00100000:3.0:1788833285.831162:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 70a01777-e892-436b-bb0e-1312d87c0a33 00000001:00100000:3.0:1788833285.831177:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788833285.831188:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1788833286.317616:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788833287.321944:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70a01777-e892-436b-bb0e-1312d87c0a33 00010000:00010000:1.0:1788833287.341320:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833287.742200:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833287.742421:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496128 00000100:00100000:3.0:1788833287.742434:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496128 00000100:00100000:3.0:1788833287.742552:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:3.0:1788833287.742567:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+7:13845:x1875727256496128:12345-192.168.206.55@tcp:41:lfs.0 00000004:00000024:3.0:1788833287.742625:0:16263:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788833287.742739:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+7:13845:x1875727256496128:12345-192.168.206.55@tcp:41:lfs.0 Request processed in 176us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833287.742747:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00080000:2.0:1788833287.742910:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833287.748705:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833287.749015:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496256 00000100:00100000:2.0:1788833287.749025:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496256 00000100:00100000:2.0:1788833287.749170:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:2.0:1788833287.749181:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70a01777-e892-436b-bb0e-1312d87c0a33+5:13845:x1875727256496256:12345-192.168.206.55@tcp:13:lfs.0 00002000:00000024:2.0:1788833287.749233:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833287.749536:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70a01777-e892-436b-bb0e-1312d87c0a33+5:13845:x1875727256496256:12345-192.168.206.55@tcp:13:lfs.0 Request processed in 357us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833287.749545:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00080000:3.0:1788833287.750491:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833287.756647:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833287.756854:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496384 00000100:00100000:0.0:1788833287.756874:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496384 00000100:00100000:0.0:1788833287.756942:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:0.0:1788833287.756963:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70a01777-e892-436b-bb0e-1312d87c0a33+5:13845:x1875727256496384:12345-192.168.206.55@tcp:13:lfs.0 00002000:00000024:0.0:1788833287.756998:0:15076:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833287.757114:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70a01777-e892-436b-bb0e-1312d87c0a33+5:13845:x1875727256496384:12345-192.168.206.55@tcp:13:lfs.0 Request processed in 153us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833287.757122:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00080000:3.0:1788833287.757472:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833287.986870:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833287.987251:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496512 00000100:00100000:1.0:1788833287.987265:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496512 00000100:00100000:1.0:1788833287.987361:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:1.0:1788833287.987374:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+10:13877:x1875727256496512:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788833287.987398:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833287.987426:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3ffd9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b289 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833287.987465:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3ffd9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b289 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833287.987479:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932e800/0x8c08e876ed3ffd9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b289 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833287.987490:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e800, rc 0) 00000100:00100000:1.0:1788833287.987568:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13877:x1875727256496512:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 196us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833287.987576:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:1.0:1788833288.000828:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833288.001098:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496640 00000100:00100000:3.0:1788833288.001113:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496640 00000100:00100000:3.0:1788833288.001186:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 91 00000100:00100000:3.0:1788833288.001199:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13877:x1875727256496640:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788833288.001719:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13877:x1875727256496640:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 521us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833288.001729:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 91 00000100:00100000:3.0:1788833288.011495:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833288.022202:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496768 00000100:00100000:0.0:1788833288.022223:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496768 00000100:00100000:0.0:1788833288.022380:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 92 00000100:00100000:0.0:1788833288.022394:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13877:x1875727256496768:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788833288.022821:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13877:x1875727256496768:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 428us (11340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833288.022832:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 92 00000100:00100000:0.0:1788833288.033684:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833288.035593:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256496896 00000100:00100000:1.0:1788833288.035613:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256496896 00000100:00100000:1.0:1788833288.035696:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00100000:1.0:1788833288.036019:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13884:x1875727256496896:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833288.036804:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13884:x1875727256496896:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 1093us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833288.036816:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00100000:1.0:1788833288.060774:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833288.062510:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497024 00000100:00100000:0.0:1788833288.062529:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497024 00000100:00100000:0.0:1788833288.062630:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:0.0:1788833288.062644:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13884:x1875727256497024:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833288.063148:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13884:x1875727256497024:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 506us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833288.063158:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 94 00000100:00100000:2.0:1788833288.069500:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833288.070172:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497152 00000100:00100000:3.0:1788833288.070186:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497152 00000100:00100000:3.0:1788833288.070263:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 95 00000100:00100000:3.0:1788833288.070274:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13877:x1875727256497152:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788833288.070295:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833288.070321:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517400/0x8c08e876ed3ffda5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b2b3 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833288.070360:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517400/0x8c08e876ed3ffda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2b3 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833288.070399:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517400/0x8c08e876ed3ffda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2b3 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833288.070412:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517400, rc 0) 00000100:00100000:3.0:1788833288.070510:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13877:x1875727256497152:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 236us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833288.070522:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 95 00000100:00100000:2.0:1788833288.076247:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833288.076533:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497280 00000100:00100000:0.0:1788833288.076546:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497280 00000100:00100000:0.0:1788833288.076618:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 96 00000100:00100000:0.0:1788833288.076630:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13877:x1875727256497280:12345-192.168.206.55@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788833288.076669:0:14383:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788833288.076707:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788833288.076711:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788833288.076715:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788833288.076718:0:14383:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788833288.087018:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13877:x1875727256497280:12345-192.168.206.55@tcp:256:mount.lustre.0 Request processed in 10365us (10766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833288.087069:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 96 00000100:00100000:2.0:1788833288.096651:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833288.097286:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497408 00000100:00100000:0.0:1788833288.097300:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497408 00000100:00100000:0.0:1788833288.097379:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 97 00000100:00100000:0.0:1788833288.097392:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13877:x1875727256497408:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788833288.097415:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833288.097447:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b2ba expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833288.097487:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833288.097511:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833288.097523:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b000, rc 0) 00000100:00100000:0.0:1788833288.097607:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13877:x1875727256497408:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 218us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833288.097635:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 97 00000100:00100000:2.0:1788833288.099764:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833288.100340:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497536 00000100:00100000:0.0:1788833288.100355:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497536 00000100:00100000:0.0:1788833288.100432:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 98 00000100:00100000:0.0:1788833288.100577:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13877:x1875727256497536:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788833288.114603:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13877:x1875727256497536:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 14142us (14831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833288.114814:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 98 00000100:00100000:2.0:1788833288.118332:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833288.118447:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497664 00000100:00100000:1.0:1788833288.118460:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497664 00000100:00100000:1.0:1788833288.118610:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 99 00000100:00100000:1.0:1788833288.118682:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13877:x1875727256497664:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788833288.119531:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13877:x1875727256497664:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 905us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833288.119553:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 99 00000100:00100000:2.0:1788833288.123174:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833288.123496:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497792 00000100:00100000:1.0:1788833288.123509:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497792 00000100:00100000:1.0:1788833288.123586:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:1.0:1788833288.123598:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13889:x1875727256497792:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833288.124269:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13889:x1875727256497792:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 668us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833288.124280:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:0.0:1788833288.131845:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833288.132000:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256497920 00000100:00100000:1.0:1788833288.132017:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256497920 00000100:00100000:1.0:1788833288.132178:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 101 00000100:00100000:1.0:1788833288.132191:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13889:x1875727256497920:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833288.132521:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13889:x1875727256497920:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 332us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833288.132531:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 101 00000100:00100000:3.0:1788833288.159209:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833288.159334:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498048 00000100:00100000:0.0:1788833288.159347:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498048 00000100:00100000:0.0:1788833288.159463:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:0.0:1788833288.159473:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1875727256498048:12345-192.168.206.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788833288.159511:0:14391:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb@192.168.206.55@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1788833288.159573:0:14391:0:(genops.c:1385:class_connect()) connect: client 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb, cookie 0x8c08e876ed3ffdb3 00000004:00100000:0.0:1788833288.159617:0:14391:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788833288.159807:0:14391:0:(import.c:65:import_set_state_nolock()) ffff9cea05ded000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788833288.159907:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:2356:x1875727256498048:12345-192.168.206.55@tcp:38:mount.lustre.0 Request processed in 433us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833288.159916:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:3.0:1788833288.169155:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833288.169207:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833288.169297:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498176 00000100:00100000:2.0:1788833288.169312:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498176 00000100:00100000:2.0:1788833288.169404:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498304 00000100:00100000:2.0:1788833288.169407:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498304 00000100:00100000:2.0:1788833288.169434:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:2.0:1788833288.169445:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+7:0:x1875727256498176:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788833288.169504:0:16263:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788833288.169606:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+7:0:x1875727256498176:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 162us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833288.169613:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:2.0:1788833288.169646:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:2.0:1788833288.169653:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:13877:x1875727256498304:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788833288.169666:0:16263:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788833288.169688:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:13877:x1875727256498304:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833288.169711:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00080000:3.0:1788833288.169956:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833288.174491:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833288.174965:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498432 00000100:00100000:2.0:1788833288.174980:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498432 00000100:00100000:2.0:1788833288.175154:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:2.0:1788833288.175168:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:13877:x1875727256498432:12345-192.168.206.55@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788833288.175292:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:13877:x1875727256498432:12345-192.168.206.55@tcp:40:mount.lustre.0 Request processed in 128us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833288.175301:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:3.0:1788833288.178625:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833288.178675:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833288.178722:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833288.178763:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498560 00000100:00100000:3.0:1788833288.178776:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498560 00000100:00100000:3.0:1788833288.178822:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498688 00000100:00100000:3.0:1788833288.178826:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498688 00000100:00100000:3.0:1788833288.178849:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:3.0:1788833288.178858:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875727256498560:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788833288.178914:0:15074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb@192.168.206.55@tcp t0 exp 0000000000000000 cur 422 last 0 00000100:00100000:1.0:1788833288.178922:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498816 00000100:00100000:1.0:1788833288.178956:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498816 00000020:00000080:3.0:1788833288.178969:0:15074:0:(genops.c:1385:class_connect()) connect: client 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb, cookie 0x8c08e876ed3ffdba 00002000:00100000:3.0:1788833288.178986:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb/ffff9cea41c73000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788833288.179001:0:15074:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:1.0:1788833288.179006:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:1.0:1788833288.179015:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:13877:x1875727256498816:12345-192.168.206.55@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788833288.179141:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788833288.179240:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:13877:x1875727256498816:12345-192.168.206.55@tcp:33:mount.lustre.0 Request processed in 225us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833288.179249:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00002000:00080000:3.0:1788833288.179371:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788833288.179425:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9cea41c70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833288.179477:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:2356:x1875727256498560:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 619us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833288.183825:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:3.0:1788833288.183891:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1788833288.183912:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875727256498688:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788833288.183987:0:15074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb@192.168.206.55@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:3.0:1788833288.184060:0:15074:0:(genops.c:1385:class_connect()) connect: client 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb, cookie 0x8c08e876ed3ffdc1 00002000:00100000:3.0:1788833288.184080:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb/ffff9cea41c75800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788833288.184094:0:15074:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788833288.184405:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788833288.184450:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9cea41c74800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833288.184556:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:2356:x1875727256498688:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 643us (5832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833288.184565:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:1.0:1788833288.356953:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833288.357241:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256498944 00000100:00100000:2.0:1788833288.357255:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256498944 00000100:00100000:2.0:1788833288.357340:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:2.0:1788833288.357353:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:13910:x1875727256498944:12345-192.168.206.55@tcp:101:mkdir.0 00010000:00010000:2.0:1788833288.357384:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833288.357416:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ba00/0x8c08e876ed3ffdc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b2e4 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833288.357502:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833288.357520:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833288.357538:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833288.357585:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788833288.357589:0:14389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833288.357635:0:14389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833288.357668:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ba00/0x8c08e876ed3ffdc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 8 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833288.357689:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833288.357699:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:2.0:1788833288.357702:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833288.357707:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b200, rc 0) 00000100:00100000:2.0:1788833288.357803:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+7:13910:x1875727256498944:12345-192.168.206.55@tcp:101:mkdir.0 Request processed in 453us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833288.357811:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00010000:00010000:2.0:1788833288.365358:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833289.327551:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265926656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833289.327651:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833289.327788:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926656 00000100:00100000:1.0:1788833289.327800:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926656 00000100:00100000:1.0:1788833289.327889:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788833289.327902:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265926656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788833289.327965:0:15076:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833289.328025:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265926656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (375us total) trans 0 rc 0/0 00000100:00080000:3.0:1788833289.328173:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833289.328218:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265926656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833289.328298:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788833289.390312:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833290.414248:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788833290.734126:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788833290.863400:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265926784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833290.863464:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833290.863530:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926784 00000100:00100000:1.0:1788833290.863537:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926784 00000100:00100000:1.0:1788833290.863587:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788833290.863596:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265926784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833290.863628:0:15076:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833290.863669:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875727265926784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833290.863676:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788833290.863705:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788833290.863732:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788833290.863752:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875727265926784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833290.866644:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265926912:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.866705:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833290.866743:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265927424:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.866783:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833290.866810:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833290.866817:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265927040:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.866844:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833290.866875:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265926912 00000100:00100000:1.0:1788833290.866882:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265926912 00000100:00100000:1.0:1788833290.866939:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788833290.866948:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3276:x1875727265926912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.866996:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3276:x1875727265926912:12345-0@lo:400:kworker.0 Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833290.867003:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788833290.867054:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265927424 00000100:00100000:1.0:1788833290.867058:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265927424 00000100:00100000:1.0:1788833290.867090:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788833290.867096:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265927424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.867124:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875727265927424:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833290.867129:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788833290.867157:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265927168:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.867179:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833290.867210:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833290.867215:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265927296:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.867546:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833290.867577:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265927168 00000100:00100000:1.0:1788833290.867581:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265927168 00000100:00100000:1.0:1788833290.867605:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265927296 00000100:00100000:1.0:1788833290.867608:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265927296 00000100:00100000:1.0:1788833290.867627:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788833290.867634:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265927168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.867670:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875727265927168:12345-0@lo:400:kworker.0 Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833290.867676:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788833290.867689:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788833290.867696:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265927296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.867722:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265927296:12345-0@lo:400:kworker.0 Request processed in 27us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833290.867727:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788833290.867747:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833290.868676:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265927296:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.868698:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875727265927168:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.868742:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265926912:0@lo:400:kworker.0 00000100:00100000:1.0:1788833290.868754:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875727265927424:0@lo:400:kworker.0 00000100:00100000:2.0:1788833290.870631:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265927040 00000100:00100000:2.0:1788833290.870643:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265927040 00000100:00100000:2.0:1788833290.870698:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833290.870707:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265927040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833290.870795:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265927040:12345-0@lo:400:kworker.0 Request processed in 90us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833290.870802:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833290.873195:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265927040:0@lo:400:kworker.0 00000001:00100000:2.0:1788833290.908650:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb 00000001:00100000:2.0:1788833290.908666:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 70a01777-e892-436b-bb0e-1312d87c0a33 00000001:00100000:0.0:1788833290.950618:0:7611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb 00000001:02000400:0.0:1788833291.279482:0:16355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788833291.444973:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833292.461340:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788833292.471907:0:6679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb 00010000:00010000:1.0:1788833293.492553:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833293.520647:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833293.520699:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833293.520746:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833293.520776:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833293.520798:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833293.520821:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833293.520850:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833293.520881:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499456 00000100:00100000:2.0:1788833293.520893:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499456 00000100:00100000:2.0:1788833293.520974:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499712 00000100:00100000:2.0:1788833293.520978:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499712 00000100:00100000:2.0:1788833293.520994:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499328 00000100:00100000:2.0:1788833293.520996:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499328 00000100:00100000:2.0:1788833293.521007:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499840 00000100:00100000:2.0:1788833293.521009:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499840 00000100:00100000:2.0:1788833293.521026:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:2.0:1788833293.521065:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+5:2357:x1875727256499456:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833293.521523:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+5:2357:x1875727256499456:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 460us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833293.521534:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:2.0:1788833293.521560:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:2.0:1788833293.521568:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2357:x1875727256499712:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833293.521600:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2357:x1875727256499712:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 35us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833293.521606:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:2.0:1788833293.521616:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:2.0:1788833293.521623:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+5:2357:x1875727256499328:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833293.521646:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+5:2357:x1875727256499328:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 24us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833293.521667:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:2.0:1788833293.521679:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1788833293.521685:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2357:x1875727256499840:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833293.521709:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2357:x1875727256499840:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 23us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833293.521715:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1788833293.521737:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499072 00000100:00100000:3.0:1788833293.521740:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499200 00000100:00100000:2.0:1788833293.521742:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499072 00000100:00100000:3.0:1788833293.521745:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499200 00000100:00100000:2.0:1788833293.521772:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 103 00000100:00100000:2.0:1788833293.521778:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:2357:x1875727256499072:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833293.521802:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499584 00000100:00100000:2.0:1788833293.521803:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:2357:x1875727256499072:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 25us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833293.521805:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499584 00000100:00100000:2.0:1788833293.521810:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 103 00000100:00100000:3.0:1788833293.521838:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:3.0:1788833293.521844:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:2357:x1875727256499200:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833293.521846:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:2.0:1788833293.521851:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:2357:x1875727256499584:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833293.521886:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:2357:x1875727256499584:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 33us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833293.521892:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00080000:2.0:1788833293.521924:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788833293.521929:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788833293.521931:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833293.522235:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:2357:x1875727256499200:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 390us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833293.522243:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:1.0:1788833294.449726:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265927552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833294.450251:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833294.450993:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265927552 00000100:00100000:3.0:1788833294.451004:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265927552 00000100:00100000:3.0:1788833294.451181:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788833294.451191:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265927552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833294.451226:0:15076:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833294.451301:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265927552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833294.451308:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788833294.451443:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265927552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788833294.453985:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788833294.487776:0:16505:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb0ee5020 20000000:00000080:3.0:1788833294.487794:0:16505:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce9020c3400 uarg=0000000000000000 20000000:01000000:3.0:1788833294.488220:0:16505:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788833294.488226:0:16505:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788833294.488230:0:16505:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788833294.488846:0:16506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788833294.489323:0:16505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788833294.501252:0:16505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788833294.503580:0:16505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503606:0:16505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503615:0:16505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 18 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503642:0:16505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503652:0:16505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503660:0:16505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503668:0:16505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503712:0:16505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503729:0:16505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 12 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833294.503743:0:16505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265927680:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833294.503847:0:16505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503855:0:16505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 12 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833294.503865:0:16505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265927808:192.168.206.55@tcp:104: 00010000:00010000:3.0:1788833294.503893:0:16505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.503922:0:16505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 18 pid: 14383 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833294.503932:0:16505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265927936:0@lo:104: 00000100:00100000:3.0:1788833294.503970:0:16505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833294.504017:0:16505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 18 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.504025:0:16505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 18 pid: 14381 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833294.504054:0:16505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc44a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265928064:0@lo:104: 00000100:00100000:3.0:1788833294.504076:0:16505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788833294.504117:0:16505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833294.504124:0:16505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 18 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833294.504132:0:16505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265928192:0@lo:104: 00000100:00100000:3.0:1788833294.504156:0:16505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833294.504166:0:16505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1264ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788833294.504321:0:14373:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788833294.504334:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265927936 00000100:00100000:0.0:1788833294.504340:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265927936 00000100:00100000:0.0:1788833294.504376:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928064 00000100:00100000:0.0:1788833294.504379:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928064 00000100:00100000:0.0:1788833294.504388:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928192 00000100:00100000:0.0:1788833294.504398:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928192 00000100:00100000:0.0:1788833294.504414:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788833294.504422:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+5:16505:x1875727265927936:12345-0@lo:104: 00010000:00010000:0.0:1788833294.504433:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504494:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788833294.504500:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+5:16505:x1875727265927936:12345-0@lo:104: Request processed in 79us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833294.504507:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788833294.504522:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788833294.504528:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+4:16505:x1875727265928064:12345-0@lo:104: 00010000:00010000:0.0:1788833294.504535:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504567:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788833294.504572:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+4:16505:x1875727265928064:12345-0@lo:104: Request processed in 45us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833294.504578:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788833294.504589:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788833294.504594:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3f5b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:16505:x1875727265928192:12345-0@lo:104: 00010000:00010000:0.0:1788833294.504601:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504635:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788833294.504640:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3f5b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+3:16505:x1875727265928192:12345-0@lo:104: Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833294.504645:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788833294.504698:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788833294.504704:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504712:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea1f037c00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:0.0:1788833294.504716:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504725:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788833294.504732:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833294.504737:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788833294.504763:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504769:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788833294.504787:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504794:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea1f037c00/0x8c08e876ed3ffc47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffc4e expref: -99 pid: 15789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504806:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788833294.504809:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504814:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925a000 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:0.0:1788833294.504817:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504829:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788833294.504836:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833294.504841:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788833294.504852:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504858:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788833294.504864:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504871:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffb13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffb1a expref: -99 pid: 15070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504880:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833294.504883:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504888:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea02faca00 already unused, calling callback (ffffffffc1a21c20) 10000000:00010000:0.0:1788833294.504891:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504897:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788833294.504903:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833294.504926:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788833294.504940:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504946:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788833294.504962:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504968:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff9cea02faca00/0x8c08e876ed3ffac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c08e876ed3ffacd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.504981:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833294.504982:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833294.504984:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833294.504990:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833294.504994:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833294.505011:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265928320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833294.505070:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833294.505093:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788833294.505098:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265928448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833294.505119:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833294.505145:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265928576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833294.505169:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833294.506129:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928320 00000100:00100000:1.0:1788833294.506138:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928320 00010000:00010000:1.0:1788833294.506167:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 19 pid: 14383 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833294.506187:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928448 00000100:00100000:1.0:1788833294.506190:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928448 00010000:00010000:1.0:1788833294.506202:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 20 pid: 14381 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833294.506215:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928576 00000100:00100000:1.0:1788833294.506218:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928576 00010000:00010000:1.0:1788833294.506235:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 21 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833294.506252:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833294.506261:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+21:3278:x1875727265928320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788833294.506273:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788833294.506274:0:16505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265927936:0@lo:104: 00010000:00010000:1.0:1788833294.506282:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 21 pid: 14383 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833294.506289:0:16505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265928064:0@lo:104: 00010000:00010000:1.0:1788833294.506295:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 21 pid: 14383 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833294.506301:0:16505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265928192:0@lo:104: 00010000:00010000:1.0:1788833294.506317:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea3932e400/0x8c08e876ed3ffc4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3ffc47 expref: 21 pid: 14383 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833294.506331:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833294.512586:0:14374:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788833294.512604:0:14374:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788833294.513065:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788833294.513085:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+20:3278:x1875727265928320:12345-0@lo:103:ldlm_bl.0 Request processed in 6823us (8011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833294.513088:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+20:3278:x1875727265928448:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788833294.513104:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788833294.513105:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833294.513117:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 20 pid: 14381 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833294.513131:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788833294.513132:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 19 pid: 14381 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833294.513141:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788833294.513150:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea09590050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3276:x1875727265928576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833294.513153:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea0925ba00/0x8c08e876ed3ffb1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3ffb13 expref: 19 pid: 14381 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833294.513160:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833294.513168:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 18 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.513170:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833294.513181:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 18 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833294.513195:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01516c00/0x8c08e876ed3ffacd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c08e876ed3ffac6 expref: 18 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833294.513206:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833294.513241:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea09590050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:3276:x1875727265928576:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (8071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833294.513248:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833294.513303:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3278:x1875727265928448:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (8181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833294.513311:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833294.514116:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265928448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833294.514128:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265928320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788833294.514715:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3276:1875727265928576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788833294.515818:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833294.519340:0:16505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265927680:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833294.519356:0:16505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16505:1875727265927808:192.168.206.55@tcp:104: 00010000:00010000:0.0:1788833294.519408:0:16505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833294.519589:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833294.519703:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833294.523013:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256499968 00000100:00100000:0.0:1788833294.523027:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256499968 00010000:00010000:0.0:1788833294.523099:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 13 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833294.523137:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500096 00000100:00100000:0.0:1788833294.523141:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500096 00010000:00010000:0.0:1788833294.523153:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 14 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833294.523174:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:0.0:1788833294.523183:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cd922b-b578-4316-b54d-a31fbf32e6e4+14:2357:x1875727256499968:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833294.523198:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833294.523203:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 14 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.523217:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 14 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.523235:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea0925b000/0x8c08e876ed3ffdac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2ba expref: 14 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833294.523251:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1788833294.523262:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:2357:x1875727256500096:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833294.523271:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833294.523276:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 13 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523286:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 13 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523298:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce90382b400/0x8c08e876ed3ffd74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b258 expref: 13 pid: 14382 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523324:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523332:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523350:0:14374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523358:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523364:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523371:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523377:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833294.523380:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523387:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.523409:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833294.523445:0:16505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833294.523456:0:16505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833294.524782:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833294.524855:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:2357:x1875727256499968:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 1669us (5263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833294.524985:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00010000:00010000:2.0:1788833294.525005:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cea01517800/0x8c08e876ed3ffdd6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833294.525050:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833294.525078:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:2357:x1875727256500096:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 1816us (5371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833294.525087:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00010000:00010000:1.0:1788833295.533805:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833295.953009:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833295.953267:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500224 00000100:00100000:1.0:1788833295.953278:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500224 00000100:00100000:1.0:1788833295.953333:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 104 00000100:00100000:1.0:1788833295.953343:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+11:13763:x1875727256500224:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833295.953358:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833295.953375:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3ffddd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b2eb expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833295.953402:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3ffddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2eb expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833295.953414:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932fa00/0x8c08e876ed3ffddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2eb expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833295.953422:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fa00, rc 0) 00000100:00100000:1.0:1788833295.953565:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13763:x1875727256500224:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 222us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833295.953572:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 104 00000100:00100000:1.0:1788833295.956118:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833295.956201:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500352 00000100:00100000:2.0:1788833295.956210:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500352 00000100:00100000:2.0:1788833295.956259:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 105 00000100:00100000:2.0:1788833295.956269:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13763:x1875727256500352:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833295.956521:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13763:x1875727256500352:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 253us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.956528:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 105 00000100:00100000:3.0:1788833295.961674:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833295.961765:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500480 00000100:00100000:1.0:1788833295.961776:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500480 00000100:00100000:1.0:1788833295.961893:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 106 00000100:00100000:1.0:1788833295.961914:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea10ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13763:x1875727256500480:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833295.962362:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea10ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13763:x1875727256500480:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 458us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833295.962370:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 106 00000100:00100000:3.0:1788833295.966975:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833295.967945:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500608 00000100:00100000:2.0:1788833295.968013:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500608 00000100:00100000:2.0:1788833295.968384:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 107 00000100:00100000:2.0:1788833295.968396:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+12:13763:x1875727256500608:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833295.968414:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833295.968445:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce90382b600/0x8c08e876ed3ffde4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b2f2 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833295.968476:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce90382b600/0x8c08e876ed3ffde4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2f2 expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833295.968487:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce90382b600/0x8c08e876ed3ffde4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2f2 expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833295.968515:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b600, rc 0) 00000100:00100000:2.0:1788833295.968631:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13763:x1875727256500608:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 237us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.968639:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 107 00000100:00100000:1.0:1788833295.972823:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833295.972993:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500736 00000100:00100000:2.0:1788833295.973007:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500736 00000100:00100000:2.0:1788833295.973086:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 108 00000100:00100000:2.0:1788833295.973098:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13763:x1875727256500736:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833295.973366:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13763:x1875727256500736:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 270us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.973375:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 108 00000100:00100000:0.0:1788833295.975640:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833295.975750:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500864 00000100:00100000:1.0:1788833295.975769:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500864 00000100:00100000:1.0:1788833295.975860:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 109 00000100:00100000:1.0:1788833295.975873:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13763:x1875727256500864:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833295.976620:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:13763:x1875727256500864:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 747us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833295.976631:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 109 00000100:00100000:2.0:1788833295.984957:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265928832:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.985099:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833295.985171:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265929344:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.985203:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833295.985235:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788833295.985244:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265928960:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.985295:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833295.985382:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929344 00000100:00100000:2.0:1788833295.985392:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929344 00000100:00100000:2.0:1788833295.985463:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788833295.985474:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265929344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833295.986004:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265928704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833295.986145:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833295.986179:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265929216:0@lo:400:kworker.0 00000100:00100000:1.0:1788833295.986205:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833295.986226:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833295.986232:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265929088:0@lo:400:kworker.0 00000100:00100000:1.0:1788833295.986255:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833295.986360:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928704 00000100:00100000:1.0:1788833295.986367:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928704 00000100:00100000:1.0:1788833295.986412:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788833295.986420:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265928704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833295.986458:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833295.986703:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265929344:12345-0@lo:400:kworker.0 Request processed in 1230us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.986733:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788833295.986754:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929216 00000100:00100000:2.0:1788833295.986758:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929216 00000100:00100000:2.0:1788833295.986796:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788833295.986803:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265929216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.986835:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875727265929216:12345-0@lo:400:kworker.0 Request processed in 32us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.986841:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788833295.986863:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928960 00000100:00100000:2.0:1788833295.986867:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928960 00000100:00100000:2.0:1788833295.986891:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929088 00000100:00100000:2.0:1788833295.986894:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929088 00000100:00100000:2.0:1788833295.986920:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833295.986927:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265928960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.986958:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265928960:12345-0@lo:400:kworker.0 Request processed in 33us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.986964:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788833295.986975:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833295.986982:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875727265929088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.987005:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875727265929088:12345-0@lo:400:kworker.0 Request processed in 25us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.987011:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788833295.987028:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788833295.987051:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833295.987494:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265928704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833295.987576:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788833295.987640:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265929088:0@lo:400:kworker.0 00000100:00100000:1.0:1788833295.987661:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265928704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833295.987672:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875727265929216:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.987967:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265928960:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.987981:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265929472:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.989355:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833295.989432:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265929344:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.989477:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265928832 00000100:00100000:2.0:1788833295.989485:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265928832 00000100:00100000:2.0:1788833295.990388:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788833295.990402:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3278:x1875727265928832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.990494:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:3278:x1875727265928832:12345-0@lo:400:kworker.0 Request processed in 95us (5395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.991177:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788833295.991255:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265928832:0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.991594:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929472 00000100:00100000:2.0:1788833295.991603:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929472 00000100:00100000:2.0:1788833295.991672:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788833295.991683:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265929472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833295.991773:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265929472:12345-0@lo:400:kworker.0 Request processed in 93us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833295.991794:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788833295.991822:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833295.991840:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265929472:0@lo:400:kworker.0 00010000:00010000:0.0:1788833296.557233:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788833296.557239:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788833296.557244:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce90343a800 from 10 10000000:01000000:1.0:1788833296.557250:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788833296.557315:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932f200/0x8c08e876ed3ffdeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833296.557329:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea3932f200/0x8c08e876ed3ffdeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833296.557342:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea3932f200/0x8c08e876ed3ffdeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833296.557376:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788833296.557594:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833296.557663:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833296.557861:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929600 00000100:00100000:2.0:1788833296.557872:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929600 00000100:00100000:2.0:1788833296.558005:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788833296.558017:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+16:14385:x1875727265929600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833296.558068:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833296.558085:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce90382ba00/0x8c08e876ed3ffdf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffdeb expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833296.558133:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce90382ba00/0x8c08e876ed3ffdf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffdeb expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833296.558267:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce90382ba00/0x8c08e876ed3ffdf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffdeb expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833296.558348:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382ba00, rc 0) 00000100:00100000:2.0:1788833296.558473:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:14385:x1875727265929600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 458us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833296.558481:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788833296.558643:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833296.558660:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea3932f200/0x8c08e876ed3ffdeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffdf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833296.558670:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea3932f200/0x8c08e876ed3ffdeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffdf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833296.559556:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833296.559810:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833296.559989:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833296.560056:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929728 00000100:00100000:0.0:1788833296.560064:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929728 00000100:00100000:0.0:1788833296.560114:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788833296.560125:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:14385:x1875727265929728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833296.560921:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:14385:x1875727265929728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 795us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833296.560932:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788833296.561059:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833296.561249:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833296.561384:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833296.561418:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c74e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788833296.564520:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929856 00000100:00100000:3.0:1788833296.564544:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929856 00000100:00100000:3.0:1788833296.564622:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788833296.564633:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:14385:x1875727265929856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833296.565222:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:14385:x1875727265929856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 589us (3836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833296.565231:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788833296.565995:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788833296.567807:0:16604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788833296.568628:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788833296.568663:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833296.568677:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea3932f200/0x8c08e876ed3ffdeb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffdf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833296.568693:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea3932f200/0x8c08e876ed3ffdeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffdf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833296.568708:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788833296.568712:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea0395f000 from 10 10000000:01000000:3.0:1788833296.568716:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833296.568770:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516600/0x8c08e876ed3ffdf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833296.568782:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea01516600/0x8c08e876ed3ffdf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833296.568797:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea01516600/0x8c08e876ed3ffdf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833296.568832:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fc47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833296.568966:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833296.569303:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1264c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788833296.571165:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265929984 00000100:00100000:1.0:1788833296.571181:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265929984 00000100:00100000:1.0:1788833296.571265:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788833296.571278:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+17:14385:x1875727265929984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833296.571299:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833296.571323:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea3932fe00/0x8c08e876ed3ffe00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffdf9 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833296.571358:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea3932fe00/0x8c08e876ed3ffe00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffdf9 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833296.571371:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea3932fe00/0x8c08e876ed3ffe00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffdf9 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833296.571381:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932fe00, rc 0) 00000100:00100000:1.0:1788833296.571490:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:14385:x1875727265929984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833296.571497:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788833296.571645:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fc47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265929984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833296.571668:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea01516600/0x8c08e876ed3ffdf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffe00 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833296.571679:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea01516600/0x8c08e876ed3ffdf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffe00 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833296.571781:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833296.571821:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833296.571872:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abe540 going to sleep for 11 seconds 00000100:00100000:3.0:1788833296.571986:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265930112 00000100:00100000:3.0:1788833296.571992:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265930112 00000100:00100000:3.0:1788833296.572024:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788833296.572064:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:14385:x1875727265930112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833296.572382:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:14385:x1875727265930112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833296.572390:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788833296.572741:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833296.572784:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833296.572834:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833296.572871:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abe540 going to sleep for 11 seconds 00000100:00100000:3.0:1788833296.572925:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265930240 00000100:00100000:3.0:1788833296.572931:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265930240 00000100:00100000:3.0:1788833296.572967:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788833296.572975:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:14385:x1875727265930240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833296.573185:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:14385:x1875727265930240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833296.573192:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788833296.573408:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788833296.577111:0:16605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788833296.577292:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788833296.577323:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788833296.577338:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea01516600/0x8c08e876ed3ffdf9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffe00 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833296.577354:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea01516600/0x8c08e876ed3ffdf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffe00 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833296.577366:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788833296.577370:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cea3f68e000 from 10 10000000:01000000:0.0:1788833296.577373:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788833296.577423:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffe07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833296.577431:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffe07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833296.577444:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffe07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833296.577474:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833296.577573:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833296.577620:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea113959c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833296.577793:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265930368 00000100:00100000:3.0:1788833296.577804:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265930368 00000100:00100000:3.0:1788833296.577874:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788833296.577889:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+18:14385:x1875727265930368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833296.577918:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833296.577938:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cea01517000/0x8c08e876ed3ffe0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c08e876ed3ffe07 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833296.577973:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cea01517000/0x8c08e876ed3ffe0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c08e876ed3ffe07 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833296.577986:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cea01517000/0x8c08e876ed3ffe0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c08e876ed3ffe07 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833296.578012:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517000, rc 0) 00000100:00100000:3.0:1788833296.578683:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265930368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 796us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833296.578692:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788833296.578980:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833296.579003:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffe07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffe0e expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833296.579016:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffe07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c08e876ed3ffe0e expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833296.579290:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833296.583019:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833296.583090:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea113959c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833296.583303:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265930496 00000100:00100000:2.0:1788833296.583315:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265930496 00000100:00100000:2.0:1788833296.583601:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788833296.583615:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea2700a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265930496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833296.584467:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea2700a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265930496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 849us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833296.584478:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788833296.586879:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833296.587241:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833296.587335:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833296.588059:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea113959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833296.591837:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265930624 00000100:00100000:1.0:1788833296.591855:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265930624 00000100:00100000:1.0:1788833296.591943:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788833296.591957:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265930624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833296.592310:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:14385:x1875727265930624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 355us (4974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833296.592320:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788833296.592801:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ce902703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b1386bc-e40b-4aca-a224-131a3ddd4df1:14385:1875727265930624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788833296.597536:0:16607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788833296.599588:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788833296.599632:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833296.599645:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffe07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffe0e expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833296.599660:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff9cea0925a000/0x8c08e876ed3ffe07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c08e876ed3ffe0e expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.581280:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833297.937320:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833297.938776:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256500992 00000100:00100000:1.0:1788833297.938797:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256500992 00000100:00100000:1.0:1788833297.938923:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:1.0:1788833297.938938:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+6:14420:x1875727256500992:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833297.938966:0:16263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833297.939000:0:16263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffe15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b2f9 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939148:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939165:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939183:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939200:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939208:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939216:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939708:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e200/0x8c08e876ed3ffe2a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939720:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e200/0x8c08e876ed3ffe2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939728:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e200/0x8c08e876ed3ffe2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833297.939757:0:16263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788833297.939761:0:16263:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833297.939805:0:16263:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e200/0x8c08e876ed3ffe2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939818:0:16263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939826:0:16263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939833:0:16263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939840:0:16263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833297.939845:0:16263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939853:0:16263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939867:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:1.0:1788833297.939878:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833297.939884:0:16263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939908:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffe1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939925:0:16263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939931:0:16263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939937:0:16263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939941:0:16263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932ee00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833297.939944:0:16263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939950:0:16263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939958:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cea08850100) 00010000:00010000:1.0:1788833297.939960:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833297.939963:0:16263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.939969:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.940012:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffe15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2f9 expref: 8 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.940814:0:16263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e200/0x8c08e876ed3ffe2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2f9 expref: 7 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833297.940827:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cea08850000) 00010000:00010000:1.0:1788833297.940830:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833297.940833:0:16263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e200, rc 0) 00000100:00100000:1.0:1788833297.940935:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+7:14420:x1875727256500992:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 2001us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833297.940945:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00080000:2.0:1788833297.943359:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833297.948281:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833297.949124:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256501248 00000100:00100000:0.0:1788833297.949142:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256501248 00000100:00100000:0.0:1788833297.949214:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:0.0:1788833297.949227:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+7:14420:x1875727256501248:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833297.949252:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833297.949278:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffe31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b300 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.949837:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.949875:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.949889:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.949918:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.949926:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.949934:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.950995:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ffe46 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951020:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ffe46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951096:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ffe46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833297.951115:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788833297.951484:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951493:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951500:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951514:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833297.951519:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951528:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951544:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cea08850000) 00010000:00010000:0.0:1788833297.951548:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833297.951553:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.951558:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.953654:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.953683:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.953692:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.953699:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833297.953705:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.953713:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.953769:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cea08db1100) 00010000:00010000:0.0:1788833297.953773:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833297.953779:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.953786:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.954542:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffe31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b300 expref: 10 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.954564:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925a600/0x8c08e876ed3ffe46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b300 expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833297.954572:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea08db1200) 00010000:00010000:0.0:1788833297.954575:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833297.954578:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925a600, rc 0) 00000100:00100000:0.0:1788833297.954686:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+9:14420:x1875727256501248:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 5460us (6420us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788833297.954696:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:3.0:1788833297.958937:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833297.959023:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256501376 00000100:00100000:1.0:1788833297.959970:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256501376 00000100:00100000:1.0:1788833297.960164:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:1.0:1788833297.960190:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+9:14420:x1875727256501376:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788833297.960813:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+9:14420:x1875727256501376:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 Request processed in 635us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833297.960824:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1788833297.995653:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833297.996597:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256501504 00000100:00100000:2.0:1788833297.996613:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256501504 00000100:00100000:2.0:1788833297.996713:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:2.0:1788833297.996726:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+9:14426:x1875727256501504:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833297.996754:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833297.996785:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382be00/0x8c08e876ed3ffe54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b307 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.996871:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.996889:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.996912:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.996930:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.996937:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.996969:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997294:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997303:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997311:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997318:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382b400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833297.997438:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997448:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997463:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:2.0:1788833297.997467:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833297.997472:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997479:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed3ffe5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997494:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997501:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997513:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997519:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833297.997522:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997529:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997536:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cea0884e400) 00010000:00010000:2.0:1788833297.997539:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833297.997542:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997547:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997587:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382be00/0x8c08e876ed3ffe54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b307 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997599:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:2.0:1788833297.997601:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833297.997604:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382be00/0x8c08e876ed3ffe54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b307 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833297.997615:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382be00, rc 0) 00000100:00100000:2.0:1788833297.997707:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+9:14426:x1875727256501504:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 984us (2069us total) trans 0 rc 301/301 00000100:00100000:2.0:1788833297.997725:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:3.0:1788833298.003563:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.003701:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256501632 00000100:00100000:0.0:1788833298.003714:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256501632 00000100:00100000:0.0:1788833298.003791:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:0.0:1788833298.003803:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:70a01777-e892-436b-bb0e-1312d87c0a33+9:14426:x1875727256501632:12345-192.168.206.55@tcp:700:lfs.0 00000100:00100000:0.0:1788833298.004162:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:70a01777-e892-436b-bb0e-1312d87c0a33+9:14426:x1875727256501632:12345-192.168.206.55@tcp:700:lfs.0 Request processed in 359us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833298.004172:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833298.007224:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.007404:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256501888 00000100:00100000:2.0:1788833298.007417:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256501888 00000100:00100000:2.0:1788833298.007541:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:2.0:1788833298.007554:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+9:14426:x1875727256501888:12345-192.168.206.55@tcp:36:lfs.0 00010000:00010000:2.0:1788833298.007637:0:16263:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833298.007671:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517a00/0x8c08e876ed3ffd97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b282 expref: 9 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.007694:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:2.0:1788833298.007700:0:16263:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833298.008012:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.008112:0:16263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 5 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.008123:0:16263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.008168:0:16263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 5 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.008183:0:16263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 5 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833298.008200:0:16263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16263:1875727265930752:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833298.008333:0:16263:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea02abea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833298.012580:0:16263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16263:1875727265930752:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833298.012623:0:16263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833298.014505:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.014649:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256502016 00000100:00100000:1.0:1788833298.014664:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256502016 00010000:00010000:1.0:1788833298.014740:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 6 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.014812:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1788833298.014824:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:2357:x1875727256502016:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833298.014844:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833298.014852:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 6 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.014867:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 6 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.014903:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3ffdcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b2e4 expref: 6 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.014923:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:1.0:1788833298.014929:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.014940:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.014949:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.014983:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833298.015086:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2357:x1875727256502016:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 263us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833298.015095:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00010000:00010000:3.0:1788833298.015200:0:16263:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.015210:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.015239:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.015262:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.015271:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788833298.016252:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788833298.017637:0:16263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788833298.017661:0:16263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.017672:0:16263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.017681:0:16263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.017689:0:16263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833298.017694:0:16263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.017702:0:16263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.017830:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea32de4000) 00010000:00010000:3.0:1788833298.017834:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833298.017841:0:16263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.017849:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3ffe69 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833298.017907:0:16263:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035917221 reply state 00000000fc6afae6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833298.017920:0:16263:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788833298.018246:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+10:14426:x1875727256501888:12345-192.168.206.55@tcp:36:lfs.0 Request processed in 10689us (11029us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788833298.018257:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00010000:00010000:2.0:1788833298.021325:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.021349:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.021357:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.021364:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833298.021369:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.021378:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.021398:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cea32de4500) 00010000:00010000:2.0:1788833298.021402:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833298.021408:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.021414:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516200/0x8c08e876ed3ffe70 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833298.085669:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.086956:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256502144 00000100:00100000:2.0:1788833298.086975:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256502144 00000100:00100000:2.0:1788833298.087090:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:2.0:1788833298.087104:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+9:14434:x1875727256502144:12345-192.168.206.55@tcp:101:lctl.0 00010000:00010000:2.0:1788833298.087136:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833298.087195:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b000/0x8c08e876ed3ffe77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b30e expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.087291:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a400/0x8c08e876ed3ffe7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.087307:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a400/0x8c08e876ed3ffe7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.087321:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a400/0x8c08e876ed3ffe7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833298.087367:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788833298.087372:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833298.087421:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a400/0x8c08e876ed3ffe7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.087456:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b000/0x8c08e876ed3ffe77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b30e expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.087481:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a400/0x8c08e876ed3ffe7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b30e expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.087490:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:2.0:1788833298.087493:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833298.087498:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382a400, rc 0) 00000100:00100000:2.0:1788833298.087792:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+10:14434:x1875727256502144:12345-192.168.206.55@tcp:101:lctl.0 Request processed in 690us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.087801:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:0.0:1788833298.121634:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.122114:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256502272 00000100:00100000:1.0:1788833298.122153:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256502272 00000100:00100000:1.0:1788833298.122283:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:1.0:1788833298.122295:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:14435:x1875727256502272:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833298.122322:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833298.122350:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffe85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b315 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.122435:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.122453:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.122468:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833298.122517:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788833298.122521:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833298.122549:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.122578:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffe85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b315 expref: 7 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.122614:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ee00/0x8c08e876ed3ffe8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b315 expref: 6 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.122623:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:1.0:1788833298.122627:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833298.122631:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932ee00, rc 0) 00000100:00100000:1.0:1788833298.122725:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:14435:x1875727256502272:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 432us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833298.122733:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:3.0:1788833298.125435:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.125588:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256502400 00000100:00100000:0.0:1788833298.125604:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256502400 00000100:00100000:0.0:1788833298.125688:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:0.0:1788833298.125701:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+6:14435:x1875727256502400:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1788833298.125725:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833298.126377:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b31c expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126479:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126496:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126508:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126525:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126537:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126544:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126655:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ffea8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126685:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ffea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.126693:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ffea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833298.129997:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833298.130011:0:14389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833298.130104:0:14389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ffea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130128:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130136:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130145:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130152:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833298.130157:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130167:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130189:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:0.0:1788833298.130193:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833298.130197:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130227:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3ffe9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130247:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130253:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130259:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130264:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ba00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833298.130267:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130274:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130283:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cea08db1100) 00010000:00010000:0.0:1788833298.130285:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833298.130288:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130295:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3ffea1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130346:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffe93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b31c expref: 8 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130378:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ffea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b31c expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.130386:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08db1c00) 00010000:00010000:0.0:1788833298.130389:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833298.130392:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b000, rc 0) 00000100:00100000:0.0:1788833298.130491:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+7:14435:x1875727256502400:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 4790us (5069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833298.130501:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:0.0:1788833298.135084:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.135461:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256502656 00000100:00100000:3.0:1788833298.135474:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256502656 00000100:00100000:3.0:1788833298.135608:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:3.0:1788833298.135621:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+7:14435:x1875727256502656:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1788833298.135648:0:16263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833298.135674:0:16263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ffeaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b323 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833298.135810:0:16263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788833298.135982:0:16263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ffeaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b323 expref: 9 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.135999:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:3.0:1788833298.136003:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833298.136008:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3ffeaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b323 expref: 9 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.136024:0:16263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517c00, rc 0) 00000100:00100000:3.0:1788833298.136144:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+8:14435:x1875727256502656:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 526us (1112us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788833298.136169:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:0.0:1788833298.139379:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.139462:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256502912 00000100:00100000:1.0:1788833298.139477:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256502912 00000100:00100000:1.0:1788833298.139554:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:1.0:1788833298.139566:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+8:14435:x1875727256502912:12345-192.168.206.55@tcp:36:lfs.0 00010000:00010000:1.0:1788833298.139641:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833298.139676:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3ffea8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b31c expref: 8 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.139703:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08db1c00) 00010000:00010000:1.0:1788833298.139729:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833298.139771:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.139787:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.139799:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788833298.140292:0:14391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3321d63 reply state 000000004510b1e2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.140304:0:14391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788833298.140314:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788833298.140430:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+9:14435:x1875727256502912:12345-192.168.206.55@tcp:36:lfs.0 Request processed in 864us (1064us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788833298.140438:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 24 00010000:00010000:3.0:1788833298.142793:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.142815:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.142836:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.142844:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932e000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833298.142849:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.142857:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.142877:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08850100) 00010000:00010000:3.0:1788833298.142881:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788833298.142886:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.142903:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3ffebd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833298.143874:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.143983:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256503168 00000100:00100000:2.0:1788833298.144019:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256503168 00000100:00100000:2.0:1788833298.144119:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:2.0:1788833298.144131:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+8:14435:x1875727256503168:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:2.0:1788833298.144438:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+9:14435:x1875727256503168:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 308us (574us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788833298.144447:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:0.0:1788833298.148315:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.148418:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256503424 00000100:00100000:2.0:1788833298.148431:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256503424 00000100:00100000:2.0:1788833298.148509:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:2.0:1788833298.148521:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+9:14435:x1875727256503424:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833298.148554:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833298.148583:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3ffec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b32a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.148682:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.148703:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.148716:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.148733:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.148753:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.148760:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833298.148952:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788833298.149120:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149129:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149135:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149142:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833298.149147:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149155:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149170:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:2.0:1788833298.149173:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833298.149178:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149185:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffecb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149200:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149206:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149224:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149230:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382ac00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833298.149233:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149239:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149250:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cea0884e700) 00010000:00010000:2.0:1788833298.149258:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833298.149261:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149267:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffed2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149311:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3ffec4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b32a expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149323:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:2.0:1788833298.149325:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833298.149329:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3ffec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b32a expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.149340:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b800, rc 0) 00000100:00100000:2.0:1788833298.149411:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+10:14435:x1875727256503424:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 892us (1110us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788833298.149429:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:0.0:1788833298.152879:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.152998:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256503552 00000100:00100000:1.0:1788833298.153013:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256503552 00000100:00100000:1.0:1788833298.153131:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:1.0:1788833298.153145:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+10:14435:x1875727256503552:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833298.153179:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833298.153211:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffee0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b331 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.153322:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.153339:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.153353:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833298.153384:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788833298.153389:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833298.153409:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.153440:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3ffee0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.153460:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.153471:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08850d00) 00010000:00010000:1.0:1788833298.153474:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833298.153497:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f000, rc 0) 00000100:00100000:1.0:1788833298.153579:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+11:14435:x1875727256503552:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 438us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833298.153587:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:0.0:1788833298.160396:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.163926:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256503680 00000100:00100000:2.0:1788833298.163946:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256503680 00000100:00100000:2.0:1788833298.164072:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:2.0:1788833298.164085:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+11:14435:x1875727256503680:12345-192.168.206.55@tcp:37:lfs.0 00000100:00100000:2.0:1788833298.175698:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+11:14435:x1875727256503680:12345-192.168.206.55@tcp:37:lfs.0 Request processed in 11599us (15300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.175715:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:0.0:1788833298.190247:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.190411:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256503936 00000100:00100000:3.0:1788833298.190425:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256503936 00000100:00100000:3.0:1788833298.190509:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1788833298.190522:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea394d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+11:14435:x1875727256503936:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:3.0:1788833298.190886:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea394d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+12:14435:x1875727256503936:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 365us (655us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788833298.190921:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:0.0:1788833298.270333:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.270738:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256504064 00000100:00100000:2.0:1788833298.270752:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256504064 00000100:00100000:2.0:1788833298.270831:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:2.0:1788833298.270843:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+10:14441:x1875727256504064:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1788833298.270869:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833298.270920:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3ffeee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b338 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271006:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271023:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271087:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271106:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271137:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271144:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271263:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b000/0x8c08e876ed3fff03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271272:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b000/0x8c08e876ed3fff03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271280:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b000/0x8c08e876ed3fff03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833298.271313:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788833298.271316:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833298.271364:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b000/0x8c08e876ed3fff03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271379:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271387:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271393:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271400:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382ac00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833298.271405:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271627:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271647:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:2.0:1788833298.271651:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833298.271657:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271664:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed3ffef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271679:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271685:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271691:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271696:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833298.271699:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271705:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271711:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cea0884e700) 00010000:00010000:2.0:1788833298.271713:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833298.271715:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271731:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3ffefc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271765:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3ffeee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b338 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271780:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b000/0x8c08e876ed3fff03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b338 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.271789:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08850d00) 00010000:00010000:2.0:1788833298.271791:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788833298.271794:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b000, rc 0) 00000100:00100000:2.0:1788833298.272744:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+11:14441:x1875727256504064:12345-192.168.206.55@tcp:101:bash.0 Request processed in 1889us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.272757:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:1.0:1788833298.279797:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.280244:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256504320 00000100:00100000:0.0:1788833298.280257:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256504320 00000100:00100000:0.0:1788833298.280376:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:0.0:1788833298.280389:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+11:14441:x1875727256504320:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:0.0:1788833298.280418:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833298.280459:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fff0a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b33f expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.280631:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.280666:0:14389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.280677:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.280723:0:14389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.280739:0:14389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 11 pid: 14391 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833298.280755:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea3fb7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14389:1875727265930880:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833298.280911:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea11395180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833298.284361:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.285641:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256504448 00000100:00100000:3.0:1788833298.285659:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256504448 00010000:00010000:3.0:1788833298.285720:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 12 pid: 14391 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833298.285781:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:3.0:1788833298.285793:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+12:2357:x1875727256504448:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833298.285811:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833298.285820:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 12 pid: 14391 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.285835:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 12 pid: 14391 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.285865:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08850d00) 00010000:00010000:3.0:1788833298.285871:0:14376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.285882:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.285901:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.285927:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833298.286012:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+12:2357:x1875727256504448:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 220us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.286081:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00010000:00010000:2.0:1788833298.289047:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3ffee7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b331 expref: 11 pid: 14391 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833298.289081:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea3fb7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14389:1875727265930880:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833298.289113:0:14389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.289125:0:14389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.289131:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.289189:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.289205:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.289217:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292118:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292142:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292155:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833298.292170:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788833298.292210:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292218:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292225:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292231:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b400 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833298.292235:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292255:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292271:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08850d00) 00010000:00010000:2.0:1788833298.292275:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833298.292281:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292287:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3fff11 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833298.292303:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df7562db reply state 00000000e6ad31e3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833298.292313:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788833298.292357:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fff0a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 14 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292373:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.292380:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:2.0:1788833298.292383:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788833298.292385:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b800, rc 0) 00000100:00100000:2.0:1788833298.292489:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+14:14441:x1875727256504320:12345-192.168.206.55@tcp:101:bash.0 Request processed in 12101us (12704us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788833298.292499:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 28 00010000:00010000:2.0:1788833298.299309:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.299389:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.299419:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.299446:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382a000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833298.299474:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.299484:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.299526:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cea0884ed00) 00010000:00010000:2.0:1788833298.299530:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833298.299536:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.299553:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.308024:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.308283:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256504576 00000100:00100000:3.0:1788833298.308297:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256504576 00000100:00100000:3.0:1788833298.308366:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:3.0:1788833298.308378:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+13:14441:x1875727256504576:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:3.0:1788833298.308410:0:16263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833298.308513:0:16263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fff2d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b346 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.308607:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.308624:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.308637:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833298.308687:0:16263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788833298.308692:0:16263:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833298.308719:0:16263:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.310654:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.310727:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517c00/0x8c08e876ed3fff2d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 15 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.310930:0:16263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 14 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.310964:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:3.0:1788833298.310968:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833298.310972:0:16263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01516a00, rc 0) 00000100:00100000:3.0:1788833298.311701:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+14:14441:x1875727256504576:12345-192.168.206.55@tcp:101:bash.0 Request processed in 3318us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.311712:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:3.0:1788833298.318303:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.319297:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256504832 00000100:00100000:2.0:1788833298.319314:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256504832 00000100:00100000:2.0:1788833298.319448:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:2.0:1788833298.319469:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+14:14441:x1875727256504832:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:3.0:1788833298.320552:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+15:14441:x1875727256504832:12345-192.168.206.55@tcp:35:bash.0 Request processed in 1085us (2254us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788833298.320564:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:0.0:1788833298.402519:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.402630:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256505088 00000100:00100000:1.0:1788833298.402645:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256505088 00000100:00100000:1.0:1788833298.402728:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:1.0:1788833298.402751:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+15:14451:x1875727256505088:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1788833298.402784:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833298.402814:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed3fff3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b34d expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833298.402962:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788833298.403162:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed3fff3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b34d expref: 17 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.403180:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cea0884e400) 00010000:00010000:1.0:1788833298.403185:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788833298.403190:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed3fff3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b34d expref: 17 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.403207:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932ec00, rc 0) 00000100:00100000:1.0:1788833298.403285:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+16:14451:x1875727256505088:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 546us (781us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788833298.403293:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:1.0:1788833298.405945:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.406137:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256505344 00000100:00100000:0.0:1788833298.406150:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256505344 00000100:00100000:0.0:1788833298.406268:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:0.0:1788833298.406280:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70a01777-e892-436b-bb0e-1312d87c0a33+16:14451:x1875727256505344:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1788833298.406580:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70a01777-e892-436b-bb0e-1312d87c0a33+17:14451:x1875727256505344:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 301us (646us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788833298.406589:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:3.0:1788833298.446201:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.446827:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256505600 00000100:00100000:2.0:1788833298.446842:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256505600 00000100:00100000:2.0:1788833298.446938:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:2.0:1788833298.446951:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+17:14454:x1875727256505600:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:2.0:1788833298.447000:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833298.447047:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b354 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.447197:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fff50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.447214:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fff50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.447227:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fff50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833298.447241:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788833298.447399:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a000/0x8c08e876ed3fff49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b354 expref: 20 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.447422:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fff50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b354 expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.447432:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:2.0:1788833298.447435:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833298.447438:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382a200, rc 0) 00000100:00100000:2.0:1788833298.447518:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+19:14454:x1875727256505600:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 570us (1332us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788833298.447526:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:3.0:1788833298.452673:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.452997:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256505728 00000100:00100000:1.0:1788833298.453011:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256505728 00000100:00100000:1.0:1788833298.453126:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:1.0:1788833298.453138:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+19:14454:x1875727256505728:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:1.0:1788833298.453229:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453248:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453259:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453289:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453296:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453303:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453308:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:1.0:1788833298.453313:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453320:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453331:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:1.0:1788833298.453334:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788833298.453354:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.453361:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.453446:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+19:14454:x1875727256505728:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 311us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833298.453453:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:1.0:1788833298.456238:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.456531:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256505984 00000100:00100000:2.0:1788833298.456545:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256505984 00000100:00100000:2.0:1788833298.456625:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:2.0:1788833298.456659:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+19:14454:x1875727256505984:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:2.0:1788833298.456992:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+20:14454:x1875727256505984:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 335us (767us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788833298.457001:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1788833298.459713:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.459941:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256506112 00000100:00100000:1.0:1788833298.459954:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256506112 00000100:00100000:1.0:1788833298.460083:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:1.0:1788833298.460096:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70a01777-e892-436b-bb0e-1312d87c0a33+20:2357:x1875727256506112:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833298.460115:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833298.460146:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fff50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b354 expref: 20 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.460169:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:1.0:1788833298.460175:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833298.460246:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70a01777-e892-436b-bb0e-1312d87c0a33+19:2357:x1875727256506112:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 153us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833298.460254:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00010000:00010000:1.0:1788833298.605389:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833298.641772:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.641824:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.641873:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.641916:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.641952:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256506496 00000100:00100000:3.0:1788833298.641964:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256506496 00000100:00100000:3.0:1788833298.642074:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256507008 00000100:00100000:3.0:1788833298.642077:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256507008 00000100:00100000:3.0:1788833298.642095:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1788833298.642106:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70a01777-e892-436b-bb0e-1312d87c0a33+5:2360:x1875727256506496:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833298.642188:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70a01777-e892-436b-bb0e-1312d87c0a33+5:2360:x1875727256506496:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 84us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.642215:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1788833298.642233:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:3.0:1788833298.642238:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2360:x1875727256507008:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833298.642262:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2360:x1875727256507008:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.642268:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00080000:3.0:1788833298.642289:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833298.642294:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833298.642315:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.642372:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.642459:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.642475:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256506624 00000100:00100000:3.0:1788833298.642478:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256506624 00000100:00100000:3.0:1788833298.642498:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256506880 00000100:00100000:3.0:1788833298.642500:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256506880 00000100:00100000:3.0:1788833298.642512:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:3.0:1788833298.642517:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70a01777-e892-436b-bb0e-1312d87c0a33+5:2360:x1875727256506624:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833298.642543:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70a01777-e892-436b-bb0e-1312d87c0a33+5:2360:x1875727256506624:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.642549:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:3.0:1788833298.642559:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:3.0:1788833298.642564:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2360:x1875727256506880:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833298.642580:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+5:2360:x1875727256506880:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 16us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.642586:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00080000:3.0:1788833298.642603:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833298.642605:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833298.642636:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256506752 00000100:00100000:3.0:1788833298.642639:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256506752 00000100:00100000:3.0:1788833298.642660:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256506368 00000100:00100000:3.0:1788833298.642662:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256506368 00000100:00100000:3.0:1788833298.642676:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:3.0:1788833298.642682:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+11:2360:x1875727256506752:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833298.642715:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ee1cb9-3c38-4229-be9b-7bd6fb3f6fcb+11:2360:x1875727256506752:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 33us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.642721:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:3.0:1788833298.642732:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:3.0:1788833298.642738:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+19:2360:x1875727256506368:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1788833298.642761:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+19:2360:x1875727256506368:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 24us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.642766:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:2.0:1788833298.643075:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256506240 00000100:00100000:2.0:1788833298.643081:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256506240 00000100:00100000:2.0:1788833298.643114:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:2.0:1788833298.643122:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:2360:x1875727256506240:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1788833298.643168:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cd922b-b578-4316-b54d-a31fbf32e6e4+13:2360:x1875727256506240:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 47us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.643176:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:3.0:1788833298.777430:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.777576:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256507264 00000100:00100000:0.0:1788833298.777590:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256507264 00000100:00100000:0.0:1788833298.777739:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:0.0:1788833298.777775:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea3fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+19:14485:x1875727256507264:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:0.0:1788833298.777804:0:16263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833298.777832:0:16263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b35b expref: -99 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.777976:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fff6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.777994:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fff6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.778006:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fff6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833298.778021:0:16263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788833298.778256:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b35b expref: 22 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.778278:0:16263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fff6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b35b expref: 21 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.778287:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:0.0:1788833298.778290:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833298.778294:0:16263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b000, rc 0) 00000100:00100000:0.0:1788833298.778373:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea3fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+21:14485:x1875727256507264:12345-192.168.206.55@tcp:101:cat.0 Request processed in 601us (957us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788833298.778381:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:3.0:1788833298.784304:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.784433:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.784554:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256507392 00000100:00100000:2.0:1788833298.784570:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256507392 00000100:00100000:2.0:1788833298.784654:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:2.0:1788833298.784665:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea114faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70a01777-e892-436b-bb0e-1312d87c0a33+21:2358:x1875727256507392:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833298.784683:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833298.784713:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fff6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b35b expref: 21 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.784739:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:2.0:1788833298.784745:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833298.784838:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea114faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70a01777-e892-436b-bb0e-1312d87c0a33+20:2358:x1875727256507392:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 169us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.784848:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:2.0:1788833298.784964:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256507648 00000100:00100000:2.0:1788833298.784985:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256507648 00000100:00100000:2.0:1788833298.785022:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1788833298.785087:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+20:14485:x1875727256507648:12345-192.168.206.55@tcp:35:cat.0 00000100:00100000:2.0:1788833298.785457:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce902703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+21:14485:x1875727256507648:12345-192.168.206.55@tcp:35:cat.0 Request processed in 426us (1021us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788833298.785465:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:3.0:1788833298.835427:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.835692:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256507904 00000100:00100000:1.0:1788833298.835725:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256507904 00000100:00100000:1.0:1788833298.835820:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:1.0:1788833298.835841:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+21:14491:x1875727256507904:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:1.0:1788833298.835904:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833298.835936:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff7a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b362 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.836129:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.836146:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 22 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.836156:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 22 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.836165:0:14391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.836222:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 22 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.836238:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 22 pid: 16263 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.836254:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14391:1875727265931008:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833298.837105:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 22 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.837120:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 22 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.837151:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14391:1875727265931136:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833298.837206:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833298.844519:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14391:1875727265931008:192.168.206.55@tcp:104: 00000100:00100000:2.0:1788833298.844721:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.844906:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.845075:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14391:1875727265931136:192.168.206.55@tcp:104: 00010000:00010000:1.0:1788833298.845109:0:14391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833298.845597:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256508032 00000100:00100000:3.0:1788833298.845606:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256508032 00010000:00010000:3.0:1788833298.845658:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 23 pid: 16263 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833298.845754:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256508160 00000100:00100000:3.0:1788833298.845758:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256508160 00010000:00010000:3.0:1788833298.845773:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 24 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833298.845837:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1788833298.845850:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0693c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70a01777-e892-436b-bb0e-1312d87c0a33+24:2358:x1875727256508032:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833298.845871:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833298.845879:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 24 pid: 16263 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.845902:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 24 pid: 16263 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.846113:0:16507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:1.0:1788833298.846123:0:16507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70a01777-e892-436b-bb0e-1312d87c0a33+24:2357:x1875727256508160:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833298.846133:0:16507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833298.846139:0:16507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 24 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.846191:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fff34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b346 expref: 24 pid: 16263 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.846458:0:16507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 23 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.846477:0:16507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed3fff1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b33f expref: 23 pid: 14389 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.846490:0:16507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:1.0:1788833298.846496:0:16507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.846507:0:16507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.846533:0:16507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.846576:0:16507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833298.846659:0:16507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70a01777-e892-436b-bb0e-1312d87c0a33+22:2357:x1875727256508160:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 537us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833298.846669:0:16507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00010000:00010000:0.0:1788833298.846753:0:14391:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.846776:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833298.846799:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788833298.847208:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed3fff7a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b362 expref: 23 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.847230:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f400/0x8c08e876ed3fff81 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b362 expref: 22 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.847240:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:0.0:1788833298.847244:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788833298.847246:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f400, rc 0) 00000100:00100000:0.0:1788833298.847286:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+22:14491:x1875727256507904:12345-192.168.206.55@tcp:101:dd.0 Request processed in 11456us (11875us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788833298.847294:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00010000:00010000:3.0:1788833298.852818:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00000100:00100000:0.0:1788833298.853003:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.853124:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256508416 00000100:00100000:1.0:1788833298.853152:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256508416 00000100:00100000:1.0:1788833298.853226:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:1.0:1788833298.853237:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+22:14491:x1875727256508416:12345-192.168.206.55@tcp:36:dd.0 00010000:00010000:3.0:1788833298.853480:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833298.853588:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0693c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70a01777-e892-436b-bb0e-1312d87c0a33+22:2358:x1875727256508032:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 7740us (8866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833298.853599:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00010000:00010000:1.0:1788833298.854805:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.854842:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.854857:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788833298.854960:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788833298.854996:0:14390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e71b2a0b reply state 00000000f5192c30 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833298.855008:0:14390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833298.855155:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+24:14491:x1875727256508416:12345-192.168.206.55@tcp:36:dd.0 Request processed in 1915us (2155us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788833298.855164:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 35 00000020:00080000:1.0:1788833298.855171:0:14390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788833298.859928:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00010000:00010000:3.0:1788833298.860948:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.860967:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.860977:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.860984:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932e000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833298.861013:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.861023:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.861064:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:3.0:1788833298.861068:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833298.861074:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.861081:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e000/0x8c08e876ed3fff8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833298.861585:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256508544 00000100:00100000:2.0:1788833298.861600:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256508544 00000100:00100000:2.0:1788833298.861674:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:2.0:1788833298.861685:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+23:14491:x1875727256508544:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:2.0:1788833298.861711:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833298.861732:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3fff96 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b369 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.861806:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3fff96 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b369 expref: 24 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.861833:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3fff96 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b369 expref: 24 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.861855:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:2.0:1788833298.861859:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833298.861861:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b200, rc 0) 00000100:00100000:2.0:1788833298.861960:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+24:14491:x1875727256508544:12345-192.168.206.55@tcp:101:dd.0 Request processed in 277us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.861981:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:2.0:1788833298.881213:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.881472:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256508800 00000100:00100000:0.0:1788833298.881486:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256508800 00000100:00100000:0.0:1788833298.881566:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:0.0:1788833298.881579:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70a01777-e892-436b-bb0e-1312d87c0a33+24:14491:x1875727256508800:12345-192.168.206.55@tcp:103:dd.0 00010000:00010000:0.0:1788833298.881599:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833298.881629:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed3fff96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b369 expref: 24 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.881653:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:0.0:1788833298.881676:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833298.881762:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70a01777-e892-436b-bb0e-1312d87c0a33+23:14491:x1875727256508800:12345-192.168.206.55@tcp:103:dd.0 Request processed in 185us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833298.881771:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:2.0:1788833298.891117:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.891271:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256508928 00000100:00100000:0.0:1788833298.891284:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256508928 00000100:00100000:0.0:1788833298.891367:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:0.0:1788833298.891380:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+23:14491:x1875727256508928:12345-192.168.206.55@tcp:58:dd.0 00010000:00010000:0.0:1788833298.891525:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.891547:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.891561:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833298.894293:0:16263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788833298.894785:0:16263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788833298.894918:0:16263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788833298.895139:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+23:14491:x1875727256508928:12345-192.168.206.55@tcp:58:dd.0 Request processed in 3748us (4024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833298.895153:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:3.0:1788833298.898102:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.898233:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256509056 00000100:00100000:2.0:1788833298.898246:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256509056 00000100:00100000:2.0:1788833298.898310:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:2.0:1788833298.898337:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+23:14491:x1875727256509056:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:2.0:1788833298.898364:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833298.898391:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b370 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.898467:0:14389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.898480:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b370 expref: 24 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.898503:0:14389:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.898518:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b370 expref: 24 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.898534:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:2.0:1788833298.898537:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833298.898542:0:14389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b370 expref: 24 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833298.898574:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382a200, rc 0) 00000100:00100000:2.0:1788833298.898659:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+24:14491:x1875727256509056:12345-192.168.206.55@tcp:101:dd.0 Request processed in 331us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.898667:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00000040:00080000:0.0:1788833298.925429:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788833298.925443:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788833298.925563:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788833298.925573:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788833298.926287:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14423:1875727265931264:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788833298.926500:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea06778a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833298.932545:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14423:1875727265931264:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788833298.935589:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.937020:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256509184 00000100:00100000:1.0:1788833298.937088:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256509184 00000100:00100000:1.0:1788833298.937173:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:1.0:1788833298.937186:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70a01777-e892-436b-bb0e-1312d87c0a33+24:14492:x1875727256509184:12345-192.168.206.55@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788833298.938300:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70a01777-e892-436b-bb0e-1312d87c0a33+24:14492:x1875727256509184:12345-192.168.206.55@tcp:900:lhsmtool_posix.0 Request processed in 1098us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833298.938315:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833298.952643:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833298.952775:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256509312 00000100:00100000:2.0:1788833298.952789:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256509312 00000100:00100000:2.0:1788833298.952863:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:2.0:1788833298.952875:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+24:14492:x1875727256509312:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788833298.952936:0:14390:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788833298.953145:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+24:14492:x1875727256509312:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 271us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833298.953154:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:2.0:1788833298.959215:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.959518:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256509440 00000100:00100000:0.0:1788833298.959531:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256509440 00000100:00100000:0.0:1788833298.959600:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:0.0:1788833298.959610:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+24:14492:x1875727256509440:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788833298.959708:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959731:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959748:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959763:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959769:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959775:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959801:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959809:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959816:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833298.959884:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788833298.959904:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833298.959921:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959934:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959941:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959949:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959955:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b200 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833298.959960:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959968:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959982:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea08db1200) 00010000:00010000:0.0:1788833298.959985:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833298.959989:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.959995:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b200/0x8c08e876ed3fffab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960011:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960027:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960082:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960088:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ae00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833298.960091:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960098:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960106:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9cea08db1100) 00010000:00010000:0.0:1788833298.960108:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833298.960111:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960117:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3fffb2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960131:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960137:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960143:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960148:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ba00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833298.960155:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960162:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960169:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:0.0:1788833298.960170:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833298.960173:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.960178:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833298.960262:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+24:14492:x1875727256509440:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 Request processed in 651us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833298.960271:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:0.0:1788833298.965442:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833298.966214:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256509696 00000100:00100000:3.0:1788833298.966232:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256509696 00000100:00100000:3.0:1788833298.966380:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:3.0:1788833298.966393:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+24:14492:x1875727256509696:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833298.966421:0:16263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833298.966447:0:16263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed3fffc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b377 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966609:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966628:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966657:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833298.966679:0:16263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788833298.966826:0:16263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966846:0:16263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966853:0:16263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966860:0:16263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516a00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833298.966864:0:16263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966873:0:16263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966898:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:3.0:1788833298.966902:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788833298.966907:0:16263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966914:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01516a00/0x8c08e876ed3fffc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966974:0:16263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed3fffc0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b377 expref: 26 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.966985:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cea08db1200) 00010000:00010000:3.0:1788833298.966987:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788833298.966999:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed3fffc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b377 expref: 26 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833298.967011:0:16263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea01517600, rc 0) 00000100:00100000:3.0:1788833298.967174:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+25:14492:x1875727256509696:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 783us (1747us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788833298.967183:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:3.0:1788833298.973374:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.973594:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256509824 00000100:00100000:0.0:1788833298.973607:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256509824 00000100:00100000:0.0:1788833298.973739:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:0.0:1788833298.973752:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+25:14492:x1875727256509824:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788833298.973796:0:14391:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788833298.973988:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+25:14492:x1875727256509824:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 237us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833298.973996:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:2.0:1788833298.981348:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833298.981476:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256510080 00000100:00100000:1.0:1788833298.981490:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256510080 00000100:00100000:1.0:1788833298.981571:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:1.0:1788833298.981589:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+25:14492:x1875727256510080:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833298.981617:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833298.981655:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fffd5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b37e expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788833298.984728:0:14390:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1788833298.984750:0:14390:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788833298.984885:0:14390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788833298.986805:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e400/0x8c08e876ed3fffdc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.986836:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e400/0x8c08e876ed3fffdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.986853:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e400/0x8c08e876ed3fffdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.987996:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f800/0x8c08e876ed3fffd5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b37e expref: 28 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.988070:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e400/0x8c08e876ed3fffdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b37e expref: 27 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833298.988082:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08850400) 00010000:00010000:1.0:1788833298.988085:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788833298.988090:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932e400, rc 0) 00000100:00100000:1.0:1788833298.988372:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+27:14492:x1875727256510080:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 6783us (7048us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788833298.988383:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:1.0:1788833298.998914:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833298.999025:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256510336 00000100:00100000:0.0:1788833298.999074:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256510336 00000100:00100000:0.0:1788833298.999152:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:0.0:1788833298.999164:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+27:14492:x1875727256510336:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788833298.999265:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833298.999303:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932e400/0x8c08e876ed3fffdc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b37e expref: 27 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999330:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08850400) 00010000:00010000:0.0:1788833298.999355:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833298.999387:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999404:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999417:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999434:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999442:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999460:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999539:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999546:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999553:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999565:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ba00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833298.999570:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999577:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999585:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cea08850d00) 00010000:00010000:0.0:1788833298.999588:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833298.999591:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999597:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ba00/0x8c08e876ed3fffea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999607:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999613:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999618:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999623:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ae00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833298.999625:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999632:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999652:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x44b44a54 (ffff9cea08db1100) 00010000:00010000:0.0:1788833298.999655:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833298.999657:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833298.999664:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed3ffff1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x44b44a54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833298.999777:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+26:14492:x1875727256510336:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 614us (889us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788833298.999786:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:3.0:1788833299.006820:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.007203:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256510464 00000100:00100000:0.0:1788833299.007217:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256510464 00000100:00100000:0.0:1788833299.007302:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:0.0:1788833299.007315:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+26:14492:x1875727256510464:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00000100:00080000:1.0:1788833299.007936:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788833299.008561:0:16263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833299.008729:0:16263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffff8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b385 expref: -99 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.008788:0:16263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fffff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.008806:0:16263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fffff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.008822:0:16263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fffff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.009199:0:16263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b400/0x8c08e876ed3ffff8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b385 expref: 28 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.009234:0:16263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b000/0x8c08e876ed3fffff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b385 expref: 27 pid: 16263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.009245:0:16263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:0.0:1788833299.009248:0:16263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788833299.009252:0:16263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea0925b000, rc 0) 00000100:00100000:0.0:1788833299.010235:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+27:14492:x1875727256510464:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 2908us (3413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833299.010250:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:3.0:1788833299.013566:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.013953:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256510720 00000100:00100000:0.0:1788833299.013968:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256510720 00000100:00100000:0.0:1788833299.014139:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:0.0:1788833299.014153:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+27:14492:x1875727256510720:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788833299.014264:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.014285:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.014299:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833299.014856:0:14391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788833299.014870:0:14391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 433080838447ns, next at 434080835038ns, rc = 0 00000004:00010000:0.0:1788833299.015005:0:14391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041e2f336 reply state 00000000c09fae45 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833299.015430:0:14391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788833299.015642:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+29:14492:x1875727256510720:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 1485us (2087us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788833299.015652:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 46 00010000:00010000:2.0:1788833299.020610:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.020646:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.020662:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.020670:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925ae00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:2.0:1788833299.020677:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.020709:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.020731:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:2.0:1788833299.020735:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788833299.020741:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.020748:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925ae00/0x8c08e876ed400006 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.021302:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833299.021567:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256510848 00000100:00100000:2.0:1788833299.021581:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256510848 00000100:00100000:2.0:1788833299.021804:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:2.0:1788833299.021817:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+28:14492:x1875727256510848:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833299.021859:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833299.021884:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b38c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.021976:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 29 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.022005:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 29 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.022028:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:2.0:1788833299.022057:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833299.022061:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382ac00, rc 0) 00000100:00100000:2.0:1788833299.022153:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+29:14492:x1875727256510848:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 338us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833299.022161:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:0.0:1788833299.025754:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833299.025858:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256510976 00000100:00100000:3.0:1788833299.025873:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256510976 00000100:00100000:3.0:1788833299.025960:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:3.0:1788833299.025977:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70a01777-e892-436b-bb0e-1312d87c0a33+5:2357:x1875727256510976:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788833299.026764:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70a01777-e892-436b-bb0e-1312d87c0a33+6:2357:x1875727256510976:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 790us (1023us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788833299.026775:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:3.0:1788833299.029772:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833299.029927:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256511232 00000100:00100000:2.0:1788833299.029941:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256511232 00000100:00100000:2.0:1788833299.030230:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:2.0:1788833299.030243:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+29:14492:x1875727256511232:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788833299.030620:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70a01777-e892-436b-bb0e-1312d87c0a33+30:14492:x1875727256511232:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 379us (862us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788833299.030630:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1788833299.032848:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833299.033250:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256511488 00000100:00100000:2.0:1788833299.033263:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256511488 00000100:00100000:2.0:1788833299.033345:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:2.0:1788833299.033357:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+30:14492:x1875727256511488:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833299.033507:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+30:14492:x1875727256511488:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 152us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833299.033515:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:3.0:1788833299.037403:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.037534:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256511616 00000100:00100000:0.0:1788833299.037549:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256511616 00000100:00100000:2.0:1788833299.037689:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:2.0:1788833299.037704:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+30:14492:x1875727256511616:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833299.037747:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833299.037773:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed400014 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b393 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.037879:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed40001b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.037932:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed40001b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.037948:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed40001b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833299.037998:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833299.038022:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed40001b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.038270:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b200/0x8c08e876ed400014 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b393 expref: 32 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.038291:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed40001b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b393 expref: 31 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.038301:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:2.0:1788833299.038304:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788833299.038308:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce90382b800, rc 0) 00000100:00100000:2.0:1788833299.038411:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+31:14492:x1875727256511616:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 711us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833299.038419:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:3.0:1788833299.041975:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.042281:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256511744 00000100:00100000:0.0:1788833299.042298:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256511744 00000100:00100000:1.0:1788833299.042445:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:1.0:1788833299.042458:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+6:2358:x1875727256511744:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833299.042478:0:15072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833299.042508:0:15072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe2f83d790a72b39a expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788833299.042543:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6e12, blocks: 0x1 00010000:00010000:1.0:1788833299.042568:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788833299.042574:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833299.042585:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 7 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.042635:0:15072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 7 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.042651:0:15072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cea3932f800, rc 0) 00000100:00100000:1.0:1788833299.042728:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+7:2358:x1875727256511744:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 273us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833299.043271:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:1.0:1788833299.047575:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833299.047688:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256512000 00000100:00100000:2.0:1788833299.047701:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256512000 00000100:00100000:2.0:1788833299.047954:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:2.0:1788833299.047969:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+31:14492:x1875727256512000:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833299.048147:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70a01777-e892-436b-bb0e-1312d87c0a33+31:14492:x1875727256512000:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 181us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833299.048172:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:3.0:1788833299.052269:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.052383:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256512128 00000100:00100000:0.0:1788833299.052397:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256512128 00000100:00100000:0.0:1788833299.052474:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:0.0:1788833299.052496:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+31:14492:x1875727256512128:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788833299.104323:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788833299.104341:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788833299.104635:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1788833299.104642:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788833299.104657:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788833299.104670:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788833299.104686:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833299.104710:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265931392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788833299.104805:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833299.106663:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265931392 00000100:00100000:0.0:1788833299.106682:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265931392 00000100:00100000:0.0:1788833299.106789:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788833299.106800:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265931392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788833299.107063:0:15074:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788833299.107067:0:15074:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788833299.107069:0:15074:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788833299.107071:0:15074:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788833298 -> 1788833298 00002000:00010000:0.0:1788833299.107073:0:15074:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788833299.107163:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3277:x1875727265931392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 364us (2357us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788833299.107171:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788833299.107381:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788833299.107562:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cea40fb0380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788833299.107571:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265931392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788833299.107863:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70a01777-e892-436b-bb0e-1312d87c0a33+14:14492:x1875727256512128:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 Request processed in 55375us (55604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833299.107873:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:3.0:1788833299.111304:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833299.111711:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256512256 00000100:00100000:1.0:1788833299.111724:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256512256 00000100:00100000:1.0:1788833299.111805:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:1.0:1788833299.111817:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+7:2357:x1875727256512256:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788833299.111978:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70a01777-e892-436b-bb0e-1312d87c0a33+7:2357:x1875727256512256:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 Request processed in 163us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833299.112003:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:1.0:1788833299.118473:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.118739:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256512512 00000100:00100000:0.0:1788833299.118770:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256512512 00000100:00100000:0.0:1788833299.118991:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:0.0:1788833299.119005:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+14:14492:x1875727256512512:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788833299.119113:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833299.119150:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b800/0x8c08e876ed40001b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b393 expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.119177:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:0.0:1788833299.119183:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833299.119288:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.119307:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.119319:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788833299.119639:0:14391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075e07e8c reply state 00000000d6aaaa45 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.119651:0:14391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833299.119784:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70a01777-e892-436b-bb0e-1312d87c0a33+15:14492:x1875727256512512:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 781us (1323us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788833299.119793:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 52 00010000:00010000:0.0:1788833299.122623:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.122654:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.122663:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.122671:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fc00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833299.122685:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.122694:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.122728:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:0.0:1788833299.122732:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833299.122737:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.122744:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932fc00/0x8c08e876ed400029 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.123137:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.123426:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256512640 00000100:00100000:0.0:1788833299.123438:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256512640 00000100:00100000:0.0:1788833299.123518:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:0.0:1788833299.123530:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70a01777-e892-436b-bb0e-1312d87c0a33+7:2358:x1875727256512640:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788833299.124411:0:15073:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788833299.124418:0:15073:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788833298 00002000:00010000:0.0:1788833299.124422:0:15073:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788833298 00002000:00010000:0.0:1788833299.124424:0:15073:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788833298 -> 1788833298 00002000:00010000:0.0:1788833299.124426:0:15073:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788833299.124802:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70a01777-e892-436b-bb0e-1312d87c0a33+8:2358:x1875727256512640:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 1269us (1666us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788833299.125756:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:0.0:1788833299.133250:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833299.133482:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256512768 00000100:00100000:3.0:1788833299.133495:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256512768 00000100:00100000:3.0:1788833299.133853:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1788833299.133866:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70a01777-e892-436b-bb0e-1312d87c0a33+8:2357:x1875727256512768:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788833299.133948:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.133971:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.133976:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.133983:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134001:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134084:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134095:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134104:0:15074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134112:0:15074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833299.134118:0:15074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134128:0:15074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134157:0:15074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.134166:0:15074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed400030 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833299.134260:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70a01777-e892-436b-bb0e-1312d87c0a33+8:2357:x1875727256512768:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 Request processed in 397us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833299.134269:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:2.0:1788833299.141787:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833299.141869:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256513024 00000100:00100000:1.0:1788833299.141884:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256513024 00000100:00100000:1.0:1788833299.141970:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:1.0:1788833299.141984:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+14:14492:x1875727256513024:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788833299.142905:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.142932:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.142971:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.143801:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.143824:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 15 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.143834:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.143895:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 15 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.143916:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 15 pid: 14390 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.143933:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14390:1875727265931520:192.168.206.55@tcp:104: 00000100:00100000:1.0:1788833299.144266:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea088ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833299.148805:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea05ca8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14390:1875727265931520:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833299.148852:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833299.149462:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833299.150692:0:16507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256513152 00000100:00100000:1.0:1788833299.150703:0:16507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256513152 00010000:00010000:1.0:1788833299.150929:0:16507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 16 pid: 14390 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.151062:0:16507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:1.0:1788833299.151073:0:16507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70a01777-e892-436b-bb0e-1312d87c0a33+16:2358:x1875727256513152:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788833299.151114:0:16507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833299.151122:0:16507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 16 pid: 14390 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.151136:0:16507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 16 pid: 14390 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.151165:0:16507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382ac00/0x8c08e876ed40000d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b38c expref: 16 pid: 14390 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.151187:0:16507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:1.0:1788833299.151193:0:16507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.151204:0:16507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.151213:0:16507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.151252:0:16507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833299.151336:0:16507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70a01777-e892-436b-bb0e-1312d87c0a33+15:2358:x1875727256513152:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 264us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833299.151344:0:16507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00010000:00010000:2.0:1788833299.151408:0:14390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.151417:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833299.151691:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788833299.151867:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788833299.151944:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788833299.152647:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14390:1875727265931648:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788833299.152734:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833299.152775:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1264ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833299.153167:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265931648 00000100:00100000:1.0:1788833299.153176:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265931648 00000100:00100000:1.0:1788833299.153269:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833299.153280:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1875727265931648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788833299.153394:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1875727265931648:12345-0@lo:1000:mdt00_001.0 Request processed in 115us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833299.153421:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833299.153509:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14390:1875727265931648:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788833299.154865:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788833299.154981:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14390:1875727265931776:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788833299.155087:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833299.155122:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea1fc76780 going to sleep for 11 seconds 00000100:00100000:3.0:1788833299.155277:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265931776 00000100:00100000:3.0:1788833299.155285:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265931776 00000100:00100000:3.0:1788833299.155348:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788833299.155359:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14390:x1875727265931776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788833299.155574:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14390:x1875727265931776:12345-0@lo:1000:mdt00_001.0 Request processed in 216us (486us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788833299.155900:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833299.156197:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14390:1875727265931776:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788833299.156253:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156267:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156276:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156283:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932ec00 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833299.156289:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156377:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156397:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:0.0:1788833299.156400:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833299.156406:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156413:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932ec00/0x8c08e876ed40003e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156453:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156460:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156466:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156471:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:0.0:1788833299.156474:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156480:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156489:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:0.0:1788833299.156491:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788833299.156501:0:14390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b370 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156528:0:14390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b370 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156538:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b370 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.156879:0:14390:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382a200/0x8c08e876ed3fffa4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b370 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833299.156908:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14390:1875727265931904:192.168.206.55@tcp:105: 00000100:00100000:0.0:1788833299.157168:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833299.160279:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14390:1875727265931904:192.168.206.55@tcp:105: 00010000:00010000:3.0:1788833299.160338:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160353:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea0925b600/0x8c08e876ed3fff9d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160395:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160436:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160449:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160463:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160470:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160477:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160483:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517600 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833299.160487:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160495:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160507:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:3.0:1788833299.160511:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833299.160515:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160521:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea01517600/0x8c08e876ed400045 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160532:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160544:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160550:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160554:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932f000 already unused, calling callback (ffffffffc1e444f0) 00010000:00010000:3.0:1788833299.160558:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160564:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160573:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cea0884e700) 00010000:00010000:3.0:1788833299.160575:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788833299.160578:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.160584:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cea3932f000/0x8c08e876ed400037 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788833299.161165:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788833299.161172:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788833299.161203:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788833299.161215:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788833299.162255:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70a01777-e892-436b-bb0e-1312d87c0a33+18:14492:x1875727256513024:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 20262us (20471us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788833299.162271:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 53 00000020:00080000:3.0:1788833299.162279:0:14390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788833299.165145:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.165345:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256513280 00000100:00100000:0.0:1788833299.165357:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256513280 00000100:00100000:0.0:1788833299.165426:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:0.0:1788833299.165438:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea394d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70a01777-e892-436b-bb0e-1312d87c0a33+18:14491:x1875727256513280:12345-192.168.206.55@tcp:49:dd.0 00000100:00100000:0.0:1788833299.165615:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea394d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70a01777-e892-436b-bb0e-1312d87c0a33+18:14491:x1875727256513280:12345-192.168.206.55@tcp:49:dd.0 Request processed in 178us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833299.165623:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:0.0:1788833299.170678:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833299.171235:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256513536 00000100:00100000:2.0:1788833299.171249:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256513536 00000100:00100000:2.0:1788833299.171332:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:2.0:1788833299.171344:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70a01777-e892-436b-bb0e-1312d87c0a33+18:14492:x1875727256513536:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788833299.172233:0:14393:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788833299.172373:0:14393:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788833299.172425:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.172448:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.172462:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.172473:0:14393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.172480:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.172486:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.172507:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788833299.172640:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70a01777-e892-436b-bb0e-1312d87c0a33+20:14492:x1875727256513536:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 1294us (1971us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788833299.172648:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000020:00080000:2.0:1788833299.172653:0:14393:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788833299.173185:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833299.173195:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.173204:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce90382b400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833299.173209:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.173218:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.173235:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cea08db1a00) 00010000:00010000:1.0:1788833299.173238:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788833299.173243:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.173248:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce90382b400/0x8c08e876ed40004c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.173263:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833299.173265:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833299.173267:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833299.302955:0:3269:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.303536:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256513664 00000100:00100000:0.0:1788833299.303551:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256513664 00000100:00100000:0.0:1788833299.303698:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:0.0:1788833299.303710:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70a01777-e892-436b-bb0e-1312d87c0a33+8:2359:x1875727256513664:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:0.0:1788833299.303821:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.303926:0:15077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 8 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.303935:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.303940:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.303945:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.303994:0:15077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 8 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.304011:0:15077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 8 pid: 15072 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833299.304068:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea40fb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15077:1875727265932032:192.168.206.55@tcp:104: 00000100:00100000:0.0:1788833299.304942:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cea05c740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833299.305657:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1788833299.305780:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.306146:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788833299.306161:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788833299.306531:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256513792 00000100:00100000:0.0:1788833299.306546:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256513792 00000100:00100000:0.0:1788833299.306622:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788833299.306630:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256513920 00000100:00100000:0.0:1788833299.306633:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256513920 00000100:00100000:3.0:1788833299.307477:0:16620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:3.0:1788833299.307492:0:16620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:70a01777-e892-436b-bb0e-1312d87c0a33+10:2360:x1875727256513792:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:3.0:1788833299.308061:0:16620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.308091:0:16620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.308097:0:16620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.308102:0:16620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.308115:0:16620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833299.308264:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea40fb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15077:1875727265932032:192.168.206.55@tcp:104: 00010000:00010000:2.0:1788833299.308302:0:15077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833299.313312:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833299.313361:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1788833299.313498:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788833299.313513:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788833299.314007:0:15078:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788833299.314014:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256514048 00000100:00100000:1.0:1788833299.314027:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256514176 00000100:00100000:0.0:1788833299.314028:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256514048 00000100:00100000:1.0:1788833299.314061:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256514176 00000100:00100000:3.0:1788833299.317677:0:16621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:3.0:1788833299.317697:0:16621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:70a01777-e892-436b-bb0e-1312d87c0a33+12:2359:x1875727256513920:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:3.0:1788833299.317741:0:16621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.317760:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.317765:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.317769:0:16621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.317779:0:16621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.319288:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833299.319332:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833299.319362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1788833299.319398:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1788833299.319452:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788833299.319474:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1788833299.319510:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256514304 00000100:00100000:0.0:1788833299.319521:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256514304 00010000:00010000:0.0:1788833299.319562:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 13 pid: 15072 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833299.319599:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:0.0:1788833299.319606:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70a01777-e892-436b-bb0e-1312d87c0a33+13:2358:x1875727256514304:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833299.319619:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833299.319638:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 13 pid: 15072 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319652:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 13 pid: 15072 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319673:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020482e16/0x8c08e876ed400022 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xe2f83d790a72b39a expref: 13 pid: 15072 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319689:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.319693:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.319697:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319705:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319713:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.319715:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.319726:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319735:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319743:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.319747:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833299.319751:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319758:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319800:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833299.319847:0:15077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833299.319854:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70a01777-e892-436b-bb0e-1312d87c0a33+12:2358:x1875727256514304:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 244us (571us total) trans 0 rc 0/0 00010000:00010000:2.0:1788833299.319898:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833299.319900:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00010000:00010000:0.0:1788833299.319933:0:16620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833299.319944:0:16620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.320165:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256514432 00000100:00100000:1.0:1788833299.320170:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256514432 00000100:00100000:1.0:1788833299.320217:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788833299.320228:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256514560 00000100:00100000:1.0:1788833299.320231:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256514560 00000100:00100000:1.0:1788833299.320261:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788833299.320270:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727256514688 00000100:00100000:1.0:1788833299.320273:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727256514688 00000100:00100000:1.0:1788833299.320878:0:16622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:1.0:1788833299.320912:0:16622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:70a01777-e892-436b-bb0e-1312d87c0a33+14:2359:x1875727256514176:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:1.0:1788833299.320947:0:16622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.320961:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833299.320965:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833299.320971:0:16622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.320986:0:16622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.321113:0:16621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.321137:0:16621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833299.423675:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1788833299.423690:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1788833299.423697:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1788833299.423706:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1788833299.424542:0:15077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:3.0:1788833299.424550:0:15077:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788833298 -> 1788833299 00002000:00010000:3.0:1788833299.424553:0:15077:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788833298 -> 1788833299 00002000:00010000:3.0:1788833299.424556:0:15077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788833299.424574:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.424586:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.424595:0:15077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.424602:0:15077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea0925b400 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833299.424607:0:15077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.424615:0:15077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.424638:0:15077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.424661:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cab1235/0x8c08e876ed400053 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833299.424764:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70a01777-e892-436b-bb0e-1312d87c0a33+21:2359:x1875727256513664:12345-192.168.206.55@tcp:4:dd.0 Request processed in 121052us (121821us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788833299.424773:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1788833299.424927:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1788833299.424939:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70a01777-e892-436b-bb0e-1312d87c0a33+20:2360:x1875727256514048:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:3.0:1788833299.424969:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.424983:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.424987:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.424993:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.425005:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833299.486010:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1788833299.486863:0:16620:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:3.0:1788833299.486881:0:16620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.486903:0:16620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.486927:0:16620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.486935:0:16620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517600 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833299.486940:0:16620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.486949:0:16620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.486971:0:16620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.486980:0:16620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a2eaa35/0x8c08e876ed40005a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833299.487096:0:16620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:70a01777-e892-436b-bb0e-1312d87c0a33+16:2360:x1875727256513792:12345-192.168.206.55@tcp:4:dd.0 Request processed in 179604us (181440us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788833299.487107:0:16620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:3.0:1788833299.487692:0:16620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:3.0:1788833299.487704:0:16620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:70a01777-e892-436b-bb0e-1312d87c0a33+15:2360:x1875727256514432:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:3.0:1788833299.487736:0:16620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.487749:0:16620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.487762:0:16620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.487769:0:16620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.487781:0:16620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.488919:0:16622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.488935:0:16622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.488943:0:16622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.488949:0:16622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea3932fc00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833299.488953:0:16622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.488961:0:16622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.488977:0:16622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.488985:0:16622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001f81785/0x8c08e876ed400068 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833299.489069:0:16622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:70a01777-e892-436b-bb0e-1312d87c0a33+15:2359:x1875727256514176:12345-192.168.206.55@tcp:4:dd.0 Request processed in 168180us (175705us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788833299.489079:0:16622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:3.0:1788833299.489104:0:16622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:3.0:1788833299.489261:0:16622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:70a01777-e892-436b-bb0e-1312d87c0a33+14:2359:x1875727256514560:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:3.0:1788833299.489288:0:16622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489299:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.489304:0:16622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.489309:0:16622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489319:0:16622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489670:0:16621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489679:0:16621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489686:0:16621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489703:0:16621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516a00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833299.489706:0:16621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489714:0:16621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489727:0:16621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489735:0:16621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b660d5/0x8c08e876ed400061 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833299.489772:0:16621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:70a01777-e892-436b-bb0e-1312d87c0a33+14:2359:x1875727256513920:12345-192.168.206.55@tcp:4:dd.0 Request processed in 172081us (183991us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788833299.489780:0:16621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:3.0:1788833299.489797:0:16621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1788833299.489804:0:16621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:70a01777-e892-436b-bb0e-1312d87c0a33+13:2360:x1875727256514688:12345-192.168.206.55@tcp:4:dd.0 00010000:00010000:3.0:1788833299.489820:0:16621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489829:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.489832:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833299.489835:0:16621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.489855:0:16621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788833299.545746:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1788833299.550601:0:15077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:2.0:1788833299.550612:0:15077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:2.0:1788833299.550628:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.550641:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.550651:0:15077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.550672:0:15077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517a00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833299.550678:0:15077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.550688:0:15077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.550709:0:15077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.550718:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000362352f4/0x8c08e876ed40006f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833299.550835:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70a01777-e892-436b-bb0e-1312d87c0a33+17:2360:x1875727256514048:12345-192.168.206.55@tcp:4:dd.0 Request processed in 125895us (237537us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788833299.550844:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:0.0:1788833299.565209:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea03528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265932160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788833299.565283:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833299.565442:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265932160 00000100:00100000:2.0:1788833299.565451:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265932160 00000100:00100000:2.0:1788833299.565513:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833299.565522:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea40fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265932160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833299.565554:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833299.565601:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea40fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265932160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833299.565608:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788833299.565663:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833299.565725:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea03528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265932160:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1788833299.579393:0:16621:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788833299.579416:0:16621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.579428:0:16621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.579437:0:16621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.579459:0:16621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517800 already unused, calling callback (ffffffffc1434350) 00010000:00010000:1.0:1788833299.579464:0:16621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.579473:0:16621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.579496:0:16621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833299.579505:0:16621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dd541cb/0x8c08e876ed400084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833299.579601:0:16621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:70a01777-e892-436b-bb0e-1312d87c0a33+15:2360:x1875727256514688:12345-192.168.206.55@tcp:4:dd.0 Request processed in 89792us (260197us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788833299.579610:0:16621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00010000:00010000:2.0:1788833299.579709:0:16622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.579724:0:16622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.579746:0:16622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.579752:0:16622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01516200 already unused, calling callback (ffffffffc1434350) 00010000:00010000:2.0:1788833299.579756:0:16622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.579761:0:16622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.579773:0:16622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833299.579779:0:16622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094527788/0x8c08e876ed40007d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833299.579814:0:16622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:70a01777-e892-436b-bb0e-1312d87c0a33+13:2359:x1875727256514560:12345-192.168.206.55@tcp:4:dd.0 Request processed in 90702us (260450us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788833299.579820:0:16622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00010000:00010000:3.0:1788833299.579997:0:16620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.580007:0:16620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.580015:0:16620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.580022:0:16620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cea01517c00 already unused, calling callback (ffffffffc1434350) 00010000:00010000:3.0:1788833299.580025:0:16620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.580061:0:16620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.580073:0:16620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833299.580080:0:16620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b41ac8/0x8c08e876ed400076 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833299.580134:0:16620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:70a01777-e892-436b-bb0e-1312d87c0a33+11:2360:x1875727256514432:12345-192.168.206.55@tcp:4:dd.0 Request processed in 92433us (260800us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788833299.580142:0:16620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000001:00080000:2.0:1788833299.580239:0:7611:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1788833299.629198:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788833300.205384:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788833300.205391:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788833300.205439:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788833300.205445:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788833300.655171:0:15713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833301.102209:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265932544:0@lo:400:kworker.0 00000100:00100000:2.0:1788833301.102277:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833301.102331:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788833301.102337:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265932672:0@lo:400:kworker.0 00000100:00100000:2.0:1788833301.102365:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833301.102399:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265932672 00000100:00100000:2.0:1788833301.102405:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265932672 00000100:00100000:2.0:1788833301.102446:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833301.102455:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265932672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833301.102598:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875727265932672:12345-0@lo:400:kworker.0 Request processed in 143us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833301.102605:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833301.102733:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875727265932672:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.102908:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265932288:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.102943:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833301.102977:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265932800:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103005:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833301.103026:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788833301.103150:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265932416:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103181:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833301.103205:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265932928:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103227:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833301.103311:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265932800 00000100:00100000:3.0:1788833301.103317:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265932800 00000100:00100000:3.0:1788833301.103362:0:16263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265932928 00000100:00100000:3.0:1788833301.103366:0:16263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265932928 00000100:00100000:3.0:1788833301.103383:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788833301.103390:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265932800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103435:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875727265932800:12345-0@lo:400:kworker.0 Request processed in 45us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833301.103442:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788833301.103461:0:16263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788833301.103467:0:16263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265932928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103514:0:16263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea03529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875727265932928:12345-0@lo:400:kworker.0 Request processed in 47us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833301.103533:0:16263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788833301.103553:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265932544 00000100:00100000:3.0:1788833301.103558:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265932544 00000100:00100000:3.0:1788833301.103586:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265932416 00000100:00100000:3.0:1788833301.103589:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265932416 00000100:00100000:3.0:1788833301.103604:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788833301.103609:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea1f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265932544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103650:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea1f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875727265932544:12345-0@lo:400:kworker.0 Request processed in 39us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833301.103656:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788833301.103667:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788833301.103673:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265932416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103701:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea0352b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875727265932416:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833301.103707:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788833301.103729:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833301.103733:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833301.103735:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833301.103764:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875727265932416:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103774:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875727265932928:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103782:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875727265932800:0@lo:400:kworker.0 00000100:00100000:3.0:1788833301.103815:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788833301.103821:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cea40fb0380, transno 8589934595 00000004:00080000:3.0:1788833301.103834:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788833301.103850:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875727265932544:0@lo:400:kworker.0 00000100:00100000:2.0:1788833301.107308:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265932288 00000100:00100000:2.0:1788833301.107326:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265932288 00000100:00100000:2.0:1788833301.107384:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788833301.107394:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea27009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3278:x1875727265932288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833301.107505:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea27009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b1386bc-e40b-4aca-a224-131a3ddd4df1+19:3278:x1875727265932288:12345-0@lo:400:kworker.0 Request processed in 112us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833301.107513:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788833301.108808:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b1386bc-e40b-4aca-a224-131a3ddd4df1:3278:1875727265932288:0@lo:400:kworker.0 00000100:00100000:1.0:1788833301.109645:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833301.109662:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cea1f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265933056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833301.109725:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833301.109857:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875727265933056 00000100:00100000:2.0:1788833301.109865:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875727265933056 00000100:00100000:2.0:1788833301.109936:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833301.109947:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265933056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833301.109997:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788833301.110081:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cea05ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875727265933056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833301.110089:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788833301.110257:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cea1f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875727265933056:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788833301.164396:0:16659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788833301.677266:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833302.702658:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29270 lines, 29270 kept, 0 dropped, 0 bad.